-- Logs begin at Thu 2022-06-02 13:32:00 UTC, end at Thu 2022-06-02 14:45:46 UTC. -- Jun 02 14:14:28.848995 dv-osbrick-830800-17-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 14:14:28.860040 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 14:14:28.862110 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 14:14:28 2022] *** Jun 02 14:14:28.862110 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 14:14:28.862110 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 14:14:28.862110 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: nodename: dv-osbrick-830800-17-ceph Jun 02 14:14:28.862110 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: machine: x86_64 Jun 02 14:14:28.862110 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: clock source: unix Jun 02 14:14:28.862110 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: pcre jit disabled Jun 02 14:14:28.862110 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: detected number of CPU cores: 4 Jun 02 14:14:28.862110 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: current working directory: / Jun 02 14:14:28.862110 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: detected binary path: /usr/bin/uwsgi-core Jun 02 14:14:28.862667 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: your processes number limit is 47680 Jun 02 14:14:28.862667 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: your memory page size is 4096 bytes Jun 02 14:14:28.862667 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: detected max file descriptor number: 2048 Jun 02 14:14:28.862667 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: lock engine: pthread robust mutexes Jun 02 14:14:28.862667 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: thunder lock: enabled Jun 02 14:14:28.862667 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 14:14:28.862667 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 14:14:28.913782 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: Python main interpreter initialized at 0x55e4c23fc9c0 Jun 02 14:14:28.913782 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: python threads support enabled Jun 02 14:14:28.913782 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: your server socket listen backlog is limited to 100 connections Jun 02 14:14:28.913782 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: your mercy for graceful operations on workers is 90 seconds Jun 02 14:14:28.914130 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 14:14:28.914251 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: *** Operational MODE: preforking *** Jun 02 14:14:28.914498 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: *** uWSGI is running in multiple interpreter mode *** Jun 02 14:14:28.914498 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: spawned uWSGI master process (pid: 87220) Jun 02 14:14:28.914717 dv-osbrick-830800-17-ceph systemd[1]: Started Devstack devstack@keystone.service. Jun 02 14:14:28.918685 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: spawned uWSGI worker 1 (pid: 87231, cores: 1) Jun 02 14:14:28.918685 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: spawned uWSGI worker 2 (pid: 87232, cores: 1) Jun 02 14:14:28.918685 dv-osbrick-830800-17-ceph devstack@keystone.service[87220]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 14:14:34.800451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 14:14:34.800451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: from cryptography.utils import int_from_bytes Jun 02 14:14:34.801257 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 14:14:34.801257 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: from cryptography.utils import int_from_bytes Jun 02 14:14:34.801669 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 14:14:34.801669 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: from cryptography.utils import int_from_bytes Jun 02 14:14:34.801776 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 14:14:34.801776 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: from cryptography.utils import int_from_bytes Jun 02 14:14:34.851939 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 14:14:34.852136 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 14:14:34.852228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 14:14:34.852319 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 14:14:34.852393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] command line args: [] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 14:14:34.852469 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] command line args: [] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 14:14:34.852550 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 14:14:34.852677 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 14:14:34.852764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ================================================================================ {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 14:14:34.852842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ================================================================================ {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 14:14:34.852965 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] admin_token = **** {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.853094 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] admin_token = **** {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.853211 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] config_dir = [] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.853343 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] config_dir = [] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.853428 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.853532 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.853621 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] config_source = [] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.853719 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] config_source = [] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.853809 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] debug = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.853903 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] debug = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.853981 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.854172 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.854277 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.854346 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.854484 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.854587 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.854723 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.854828 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.854970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.855077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.855204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] list_limit = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.855315 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] list_limit = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.855418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] log_config_append = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.855522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] log_config_append = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.855629 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.855734 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.855832 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] log_dir = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.855934 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] log_dir = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856029 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] log_file = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856133 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] log_file = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856395 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856539 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856603 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856666 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856813 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.856991 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.857066 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.857170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.857296 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.857416 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.857536 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.857688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.857805 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.857952 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.858097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.858236 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.858351 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.858425 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.858546 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.858711 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.858832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.858907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.859027 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.859147 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.859232 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.859424 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.859503 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.859906 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.860027 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.860109 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] publish_errors = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.860180 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] publish_errors = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.860310 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.860387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.860538 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.860618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.860715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.860961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.861165 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.861276 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.861356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.861427 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] standard_threads = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.861494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] standard_threads = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.861632 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.861723 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.861876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.862066 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.862066 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.862241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.862313 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] use_journal = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.862397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] use_journal = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.862475 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] use_json = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.862552 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] use_json = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.862622 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] use_stderr = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.862845 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] use_stderr = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.862929 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] use_syslog = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.863008 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] use_syslog = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.863084 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.863153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 14:14:34.863227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.863297 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.863417 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.863496 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.863676 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.863759 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.863913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.863996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.864161 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.864239 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.864398 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.864481 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.864644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.864720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.864880 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.864961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.865128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.865212 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.865377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.865454 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.865626 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.865706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.865858 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.865935 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.866104 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.866181 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.866339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.866427 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.866585 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.866701 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.866859 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.866937 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.867096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.867179 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.867352 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.867429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.867608 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.867690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.867853 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.867930 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.868088 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.868164 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.868341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.868417 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.868602 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.868679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.868854 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.868930 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.869106 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.869182 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.869336 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.869420 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.869567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.869649 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.869797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.869873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.870031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.870108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.870279 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.870360 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.870528 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.870615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.870781 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.870869 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.871014 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.871090 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.871258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.871342 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.871507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.871619 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.871741 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.871820 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.871991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.872080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.872220 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.872308 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.872451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.872527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.872684 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.872771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.872914 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.872997 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.873142 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.873218 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.873909 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.874033 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.874178 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.874303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.874462 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.874604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.874782 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.874856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.874939 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.875020 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.875098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.875175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.875291 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.875370 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.875528 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.875608 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.875764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.875841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.876014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.876093 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.876247 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.876327 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.876484 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.876561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.876719 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.876795 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.876954 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.877033 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.877188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.877264 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.877422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.877498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.877649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.877733 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.877896 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.877979 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.878131 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.878209 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.878368 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.878743 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.878877 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.879022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.879201 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.879285 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.879374 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.879451 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.879606 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.879674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.879843 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.879910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.880081 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.880161 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.880348 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.880415 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.880587 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.880653 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.880836 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.880911 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.881082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.881173 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.881319 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.881429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.881609 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.881686 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.881789 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.881894 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.882037 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.882164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.882275 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.882371 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.882511 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.882610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.882786 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.882911 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.883011 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.883121 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.883250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.883358 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.883487 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.883593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.883724 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.883830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.884438 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.884517 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.884588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.884657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.884726 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.884805 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.884878 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.884947 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.885017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.885086 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.885155 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.885237 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.885342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.885422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.885577 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.885656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.885811 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.885900 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.886041 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.886118 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.886272 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.886349 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.886501 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.886590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.886758 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.886840 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.886989 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.887065 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.887227 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.887317 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.887462 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.887541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.887708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.887787 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.887943 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.888031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.888197 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.888275 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.888452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.888531 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.888692 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.888778 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.889537 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] auth.external = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.889675 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] auth.external = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.889870 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.890084 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.890275 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.890428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.890544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.890671 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.890779 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] auth.password = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.890891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] auth.password = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.890998 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] auth.token = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.891103 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] auth.token = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.891210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.891309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.891406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.891504 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.891608 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.891718 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.891850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.891957 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.892102 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.892210 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.892351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.892458 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.892647 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.892751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.892849 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] credential.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.892948 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] credential.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.893045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.893142 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.893283 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.893397 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.893533 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.893649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.893772 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.893879 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.894018 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.894125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.894254 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.894360 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.894518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.894678 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.894796 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.894878 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.895033 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.895112 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.895287 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.895365 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.895570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.895650 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.895817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.895896 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.896079 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.896157 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.896320 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.896400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.896604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.896689 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.896813 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] federation.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.896892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] federation.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.897050 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.897129 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.897296 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.897371 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.897546 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.897623 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.897777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.897856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.898027 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.898106 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.898265 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.898342 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.898519 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.898597 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.898777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.898856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.899033 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.899112 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.899270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.899359 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.899516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.899594 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.899749 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.899827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.899997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.900076 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.900244 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.900322 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.900479 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.900567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.900712 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.900790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.900958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.901035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.901189 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.901275 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.901426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.901505 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.901674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.901752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.901925 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.902010 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.902158 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.902243 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.902386 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.902464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.902616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.902757 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.902882 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.902962 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.903128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.903206 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.903375 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.903526 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.903631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.903710 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.903879 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.903957 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.904147 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.904232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.904385 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.904464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.904725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.904873 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.905009 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.905163 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.905308 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.905402 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.905475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.905595 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.905676 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.905836 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.905917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.906079 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.906158 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.906318 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.906398 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.906569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.906671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.906836 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.906916 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.907085 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.907164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.907324 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.907412 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.907557 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.907636 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.907804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.907883 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.908034 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.908114 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.908273 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.908353 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.908505 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.908584 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.908733 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.908813 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.908968 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.909047 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.909201 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.909281 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.909438 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.909517 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.909673 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.909751 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.909912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.909991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.910157 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.910237 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.910389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.910467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.910620 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.910755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.910876 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.910957 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.911124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.911202 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.911361 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.911439 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.911596 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.911678 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.911830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.911908 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.912059 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.912136 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.912289 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.912368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.912531 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.912610 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.912761 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.912839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.913008 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.913089 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.913254 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.913333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.913498 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.913584 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.913733 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.913812 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.913962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.914041 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.914189 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.914275 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.914422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.914499 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.914671 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.914753 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.914905 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.914999 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.915151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.915277 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.915398 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.915538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.915645 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.915796 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.915894 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.916023 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.916141 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.916271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.916372 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.916520 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.916620 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.916752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.916857 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.916999 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.917077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.917236 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.917323 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.917471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.917550 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.917706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.917785 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.917946 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.918027 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.918192 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.918274 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.918438 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.918516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.918694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.918777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.918952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.919032 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.919184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.919262 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.919416 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.919496 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.919650 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.919727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.919884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.919961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.920147 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.920251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.920383 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.920520 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.920661 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.920785 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.920866 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] resource.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.920930 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.921092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.921173 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.921332 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] resource.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.921410 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.921567 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.921646 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.921826 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.921943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.922058 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.922135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.922296 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.922375 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.922544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.922623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.922804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.922883 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.923043 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.923123 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.923281 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] role.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.923359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.923520 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.923597 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] role.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.923751 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.923830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] role.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.923999 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] role.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.924076 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.924232 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.924311 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.924481 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.924560 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.924728 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.924808 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.924976 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.925054 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.925222 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.925302 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.925467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.925552 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.925715 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.925801 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.925949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.926027 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.926197 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.926276 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.926448 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.926536 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.926734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.926818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.926987 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.927065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.927244 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.927405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.927486 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.927643 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.927894 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.927972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.928131 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.928216 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.928384 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.928463 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.928632 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.928710 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.928870 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.928958 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.929119 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.929197 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.929355 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.929433 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.929594 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.929687 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.929827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.929913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.930060 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.930138 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.930291 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.930377 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.930525 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.930603 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.930782 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.930862 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.931035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.931113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.931271 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.931349 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.931507 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.931587 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.931739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.931819 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.931972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.932050 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] token.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.932202 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.932280 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.932437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] token.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.932518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.932672 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.932749 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.932919 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.932996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.933153 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.933233 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.933389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.933466 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.933641 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.933724 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.933868 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.933948 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.934112 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.934191 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.934346 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.934424 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.934584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.934678 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.934842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.934921 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.935082 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.935160 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.935317 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.935398 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.935546 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.935624 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.936319 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.936457 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.936584 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.936696 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.936814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.936935 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.connection = **** {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.937067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.937155 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.937307 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.connection = **** {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.937397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.937550 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.937638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.937796 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.937877 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.938032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.938110 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.938266 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.938353 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.938501 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.938580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.938759 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.938842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.938994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.939156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.939233 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.939303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.939459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.939538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.939693 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.939779 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.939936 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.940016 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.940170 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.940249 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.940415 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.940507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.940648 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.940728 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.940888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.940967 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.941116 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.941203 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.941277 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 14:14:34.941430 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.941670 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 14:14:34.941840 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 14:14:34.970959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:34.971186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:34.971385 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:34.971471 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:34.971615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:34.971839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:34.980056 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:34.980484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.010529 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.010778 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.010864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.011087 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.064057 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.064478 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.113330 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.113562 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.114509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.114776 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.181749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.181975 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.182064 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.182198 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.182304 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.182421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.182503 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.182655 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.182739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.182876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.182960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.183090 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.206972 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.207200 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.207302 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.207428 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.207510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.207652 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.207734 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.207868 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.207951 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.208079 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.208161 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.208288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.208369 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.208543 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.219600 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.220006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.232091 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.232325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.232529 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.233205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.233399 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.233588 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.233737 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.234028 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.234163 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.234309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.234440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.234569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.234569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.234569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 14:14:35.251369 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.251580 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 14:14:35.251712 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.251841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 14:14:35.252019 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.252148 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 14:14:35.252286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.252414 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.252540 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 14:14:35.252666 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.252800 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.252925 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.253051 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.253176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.253303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.253684 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.264360 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.264634 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.264774 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.264901 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.265029 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.265170 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.265305 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.265545 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.273258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.273716 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.276549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.276829 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.277112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.277240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.277394 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.277531 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.277661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.277788 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.278021 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.278148 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.278282 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.278410 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.278560 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.278719 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.278847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.278977 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.279117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.279248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.279378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.279528 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.279711 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.279901 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.306530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.307345 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.308161 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.308438 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.308953 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.309230 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.314485 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.314744 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.315027 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.315189 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.315463 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.315738 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.322269 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.322549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.323071 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.323354 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.328714 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.329002 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.329283 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.329564 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.329836 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.329957 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.330107 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.330241 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.330371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.330521 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.330662 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.330827 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.331102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.331375 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.331638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.331898 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.349535 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.349819 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.350926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.351207 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.354394 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.355788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.358756 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.359066 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.360108 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.360401 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.364070 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.365489 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.367718 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.369101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.371479 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.371774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.372052 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.372330 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.372608 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.372890 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.372972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.373192 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.373663 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.373957 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.374234 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.374518 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.393064 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.393445 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.393714 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.393978 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.394882 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.395258 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.395529 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.395792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.402575 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.403737 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.404012 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.404847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.407103 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.407372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.407751 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.408032 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.408324 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.408605 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.408894 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.410434 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.410737 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.411020 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.411302 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.411594 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.422433 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.422728 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.423010 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.423288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.423571 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.423843 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.424126 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.425149 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.425427 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.425705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.425980 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.426255 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.426536 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.426838 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.442186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.444779 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.445439 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.448050 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.448806 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.450478 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.452063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.452773 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.453051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.453330 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.453915 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.455581 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.455856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.456133 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.460769 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.462386 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.463642 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.465248 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.465606 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.465895 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.466179 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.466454 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.469299 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.469602 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.469883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.470157 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.476279 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.476569 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.476849 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.479614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.479908 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.480186 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.484742 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.485019 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.485297 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.485569 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.485850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.486119 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.486388 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.486682 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.486963 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.487236 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.487518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.487775 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.488043 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.488302 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.488410 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 14:14:35.488664 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.488945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.489220 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.489491 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.489771 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.490052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.490328 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.490596 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.490891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.491157 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.491429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.491701 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.491959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 14:14:35.527841 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e4c23fc9c0 pid: 87232 (default app) Jun 02 14:14:35.531355 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e4c23fc9c0 pid: 87231 (default app) Jun 02 14:14:35.531453 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf548-ae91-4425-939f-f2c418ef7fbd None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:35.531658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf548-ae91-4425-939f-f2c418ef7fbd None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:35.531941 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf548-ae91-4425-939f-f2c418ef7fbd None None] PATH_INFO: `/v3` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:35.536186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Thu Jun 2 14:14:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:14:44.818018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af1eb7-46bd-4f33-9b15-042324bdf12c None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:44.818577 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af1eb7-46bd-4f33-9b15-042324bdf12c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:44.818577 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af1eb7-46bd-4f33-9b15-042324bdf12c None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:44.822973 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:14:44.828404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:44.828823 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:44.828964 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:44.901496 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: INFO dbcounter [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] Registered counter for database keystone Jun 02 14:14:44.923844 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG oslo_db.sqlalchemy.engines [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 14:14:44.930017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writer thread running {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 14:14:45.213764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG passlib.handlers.bcrypt [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87232) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 14:14:45.214190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG passlib.handlers.bcrypt [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87232) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 14:14:45.271011 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:45.272645 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:45.402027 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 575 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 02 14:14:45.565640 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af1eb7-46bd-4f33-9b15-042324bdf12c None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:45.639605 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: INFO dbcounter [None req-f8af1eb7-46bd-4f33-9b15-042324bdf12c None None] Registered counter for database keystone Jun 02 14:14:45.659455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG oslo_db.sqlalchemy.engines [None req-f8af1eb7-46bd-4f33-9b15-042324bdf12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 14:14:45.665620 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writer thread running {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 14:14:45.893283 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af1eb7-46bd-4f33-9b15-042324bdf12c None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:45.897690 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75019553-713b-4ac4-92e4-0abd347d2995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:45.898351 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75019553-713b-4ac4-92e4-0abd347d2995 admin admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:45.898658 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75019553-713b-4ac4-92e4-0abd347d2995 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:45.898952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75019553-713b-4ac4-92e4-0abd347d2995 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:45.907741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75019553-713b-4ac4-92e4-0abd347d2995 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:45.958378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: WARNING keystone.common.rbac_enforcer.enforcer [None req-75019553-713b-4ac4-92e4-0abd347d2995 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 14:14:45.958748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75019553-713b-4ac4-92e4-0abd347d2995 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:45.968657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Thu Jun 2 14:14:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:14:45.974780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:45.990372 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ab59-aa81-4fea-a3a8-ba651ffc893c None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:45.994914 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77419414-f791-4d73-8169-2216a0f0120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:45.997017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419414-f791-4d73-8169-2216a0f0120e admin admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:45.997307 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419414-f791-4d73-8169-2216a0f0120e admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:45.997589 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77419414-f791-4d73-8169-2216a0f0120e admin admin] PATH_INFO: `/v3/projects/47e2c6597d274fcc88b12f356f1b2eb0` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:46.000055 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77419414-f791-4d73-8169-2216a0f0120e admin admin] RBAC: Authorizing `identity:get_project(project_id=47e2c6597d274fcc88b12f356f1b2eb0)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:46.052647 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: WARNING keystone.common.rbac_enforcer.enforcer [None req-77419414-f791-4d73-8169-2216a0f0120e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 14:14:46.053009 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77419414-f791-4d73-8169-2216a0f0120e admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:46.057729 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Thu Jun 2 14:14:45 2022] GET /identity/v3/projects/47e2c6597d274fcc88b12f356f1b2eb0 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:14:48.368246 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dbf06-6e4e-4192-9e84-9bf246e12d07 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:48.368759 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dbf06-6e4e-4192-9e84-9bf246e12d07 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:48.368854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dbf06-6e4e-4192-9e84-9bf246e12d07 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:48.373443 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:14:48.379202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d35f09-d3e1-44f7-bedb-ad352b60a494 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:48.379585 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d35f09-d3e1-44f7-bedb-ad352b60a494 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:48.379768 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d35f09-d3e1-44f7-bedb-ad352b60a494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:48.399219 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-d5d35f09-d3e1-44f7-bedb-ad352b60a494 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:48.400809 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-d5d35f09-d3e1-44f7-bedb-ad352b60a494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:48.408852 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 14:14:48.432454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dbf06-6e4e-4192-9e84-9bf246e12d07 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:48.445377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dbf06-6e4e-4192-9e84-9bf246e12d07 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:48.449643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475afd05-5e81-4dce-9aca-9ea2e532feac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:48.451816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475afd05-5e81-4dce-9aca-9ea2e532feac admin admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:48.451816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475afd05-5e81-4dce-9aca-9ea2e532feac admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:48.451816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475afd05-5e81-4dce-9aca-9ea2e532feac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:48.459573 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475afd05-5e81-4dce-9aca-9ea2e532feac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:48.461360 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475afd05-5e81-4dce-9aca-9ea2e532feac admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:48.470378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Thu Jun 2 14:14:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:14:48.475834 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d35f09-d3e1-44f7-bedb-ad352b60a494 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:48.484982 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d35f09-d3e1-44f7-bedb-ad352b60a494 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:48.489691 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104e08e-9a56-4198-b25f-1576763db264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:48.490549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104e08e-9a56-4198-b25f-1576763db264 admin admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:48.490864 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104e08e-9a56-4198-b25f-1576763db264 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:48.491138 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104e08e-9a56-4198-b25f-1576763db264 admin admin] PATH_INFO: `/v3/users/178ae9fcbcd542059cfd780cab7fed93` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:48.492528 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104e08e-9a56-4198-b25f-1576763db264 admin admin] RBAC: Authorizing `identity:get_user(user_id=178ae9fcbcd542059cfd780cab7fed93)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:48.494381 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104e08e-9a56-4198-b25f-1576763db264 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:48.495988 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Thu Jun 2 14:14:48 2022] GET /identity/v3/users/178ae9fcbcd542059cfd780cab7fed93 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:14:50.914823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c5c1-757e-4201-ab1d-e8e05965fd3a None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:50.915321 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c5c1-757e-4201-ab1d-e8e05965fd3a None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:50.915429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c5c1-757e-4201-ab1d-e8e05965fd3a None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:50.916625 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dde90-e4a9-4892-ba8d-fc22588ed6a9 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:50.917191 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:14:50.917278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dde90-e4a9-4892-ba8d-fc22588ed6a9 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:50.917278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dde90-e4a9-4892-ba8d-fc22588ed6a9 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:50.918557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:14:50.922569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b51991-bb50-49d7-9e38-5914c65efb19 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:50.923260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b51991-bb50-49d7-9e38-5914c65efb19 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:50.923260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b51991-bb50-49d7-9e38-5914c65efb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:50.924335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e67465-48c7-4b8e-8d79-6369d12e226e None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:50.924628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e67465-48c7-4b8e-8d79-6369d12e226e None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:50.924913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e67465-48c7-4b8e-8d79-6369d12e226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:50.941878 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-08e67465-48c7-4b8e-8d79-6369d12e226e None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:50.943928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-08e67465-48c7-4b8e-8d79-6369d12e226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:50.964360 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG passlib.handlers.bcrypt [None req-50b51991-bb50-49d7-9e38-5914c65efb19 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87231) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 14:14:50.964793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG passlib.handlers.bcrypt [None req-50b51991-bb50-49d7-9e38-5914c65efb19 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87231) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 14:14:51.012303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-50b51991-bb50-49d7-9e38-5914c65efb19 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:51.014571 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-50b51991-bb50-49d7-9e38-5914c65efb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:51.024585 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 7/12] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:14:51.049779 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e67465-48c7-4b8e-8d79-6369d12e226e None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:51.073696 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:51.117490 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 6/13] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:14:51.143859 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b51991-bb50-49d7-9e38-5914c65efb19 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:51.155332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e67465-48c7-4b8e-8d79-6369d12e226e None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:51.188524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeb4ce-5424-4acb-8140-f2137e0bd1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:51.189315 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeb4ce-5424-4acb-8140-f2137e0bd1ca None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:51.189593 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeb4ce-5424-4acb-8140-f2137e0bd1ca None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:51.189865 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeb4ce-5424-4acb-8140-f2137e0bd1ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:51.200836 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfeb4ce-5424-4acb-8140-f2137e0bd1ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-9bfeb4ce-5424-4acb-8140-f2137e0bd1ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:14:51.212840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:14:51.213771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:14:51.214688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 8/14] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:14:51.220564 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeb4ce-5424-4acb-8140-f2137e0bd1ca None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:51.248542 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b51991-bb50-49d7-9e38-5914c65efb19 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:51.250952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:51.289371 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce6ea1-cdad-4464-bfb5-bee2cee29a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:51.290264 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce6ea1-cdad-4464-bfb5-bee2cee29a9f None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:51.290551 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce6ea1-cdad-4464-bfb5-bee2cee29a9f None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:51.290865 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce6ea1-cdad-4464-bfb5-bee2cee29a9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:51.302953 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:51.320597 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeb4ce-5424-4acb-8140-f2137e0bd1ca None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:51.355713 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d82a2-25ef-4638-b431-0023dce32f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:51.356379 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d82a2-25ef-4638-b431-0023dce32f6a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:51.356665 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d82a2-25ef-4638-b431-0023dce32f6a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:51.356943 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d82a2-25ef-4638-b431-0023dce32f6a None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:51.357738 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d82a2-25ef-4638-b431-0023dce32f6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:14:51.358043 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d82a2-25ef-4638-b431-0023dce32f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:51.359469 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d82a2-25ef-4638-b431-0023dce32f6a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:51.360789 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce6ea1-cdad-4464-bfb5-bee2cee29a9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:51.362310 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce6ea1-cdad-4464-bfb5-bee2cee29a9f None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:51.371405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 9/15] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:51.377697 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d82a2-25ef-4638-b431-0023dce32f6a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:51.462709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 7/16] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 14:14:51.468896 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce6ea1-cdad-4464-bfb5-bee2cee29a9f None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:51.471645 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:51.480144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d82a2-25ef-4638-b431-0023dce32f6a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:51.515122 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92cf13-9255-45d1-8169-a79e7eed3175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:51.515998 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92cf13-9255-45d1-8169-a79e7eed3175 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:51.516285 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92cf13-9255-45d1-8169-a79e7eed3175 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:51.516564 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92cf13-9255-45d1-8169-a79e7eed3175 None admin] PATH_INFO: `/v3/users/178ae9fcbcd542059cfd780cab7fed93` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:51.517782 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92cf13-9255-45d1-8169-a79e7eed3175 None admin] RBAC: Authorizing `identity:get_user(user_id=178ae9fcbcd542059cfd780cab7fed93)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:51.519299 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92cf13-9255-45d1-8169-a79e7eed3175 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:51.520928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 10/17] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:14:51 2022] GET /identity/v3/users/178ae9fcbcd542059cfd780cab7fed93 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:51.526274 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92cf13-9255-45d1-8169-a79e7eed3175 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:51.541030 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:51.568529 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce6ea1-cdad-4464-bfb5-bee2cee29a9f None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:51.603878 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5760d-27e1-4a6a-92d7-92e26ba1094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:51.604676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5760d-27e1-4a6a-92d7-92e26ba1094d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:51.604964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5760d-27e1-4a6a-92d7-92e26ba1094d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:51.605245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5760d-27e1-4a6a-92d7-92e26ba1094d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:51.624413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5760d-27e1-4a6a-92d7-92e26ba1094d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:51.625978 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5760d-27e1-4a6a-92d7-92e26ba1094d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:51.627176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92cf13-9255-45d1-8169-a79e7eed3175 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-0da5760d-27e1-4a6a-92d7-92e26ba1094d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:14:51.647190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:14:51.648062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:14:51.648993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:14:51.648993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:14:51.648993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:14:51.648993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:14:51.648993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 8/18] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:14:51.654817 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5760d-27e1-4a6a-92d7-92e26ba1094d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:51.661631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeb9fd-44c5-4385-ae66-e6077042694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:51.662492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb9fd-44c5-4385-ae66-e6077042694e None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:51.662842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb9fd-44c5-4385-ae66-e6077042694e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:51.663122 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeb9fd-44c5-4385-ae66-e6077042694e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:51.664323 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eeb9fd-44c5-4385-ae66-e6077042694e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:51.665798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eeb9fd-44c5-4385-ae66-e6077042694e None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:51.667463 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 11/19] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:14:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:51.673777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeb9fd-44c5-4385-ae66-e6077042694e None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:51.712839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:51.756328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:51.756500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5760d-27e1-4a6a-92d7-92e26ba1094d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:51.776830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeb9fd-44c5-4385-ae66-e6077042694e None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:51.790667 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4e6af-090f-478c-8010-a2e7e3e27be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:51.791328 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e6af-090f-478c-8010-a2e7e3e27be2 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:51.791612 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e6af-090f-478c-8010-a2e7e3e27be2 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:51.791893 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e6af-090f-478c-8010-a2e7e3e27be2 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:51.792621 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4e6af-090f-478c-8010-a2e7e3e27be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:14:51.792926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4e6af-090f-478c-8010-a2e7e3e27be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:51.794344 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4e6af-090f-478c-8010-a2e7e3e27be2 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:51.811386 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 9/20] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:51.812591 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b0f50-90c0-4545-989b-b9ee01942bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:51.813375 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0f50-90c0-4545-989b-b9ee01942bcb None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:51.813630 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0f50-90c0-4545-989b-b9ee01942bcb None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:51.813903 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b0f50-90c0-4545-989b-b9ee01942bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:51.814768 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b0f50-90c0-4545-989b-b9ee01942bcb None admin] RBAC: Adding query filter params (role.id=61482861f00e45048fc1d45570c4c99b, scope.domain.id=default, user.id=178ae9fcbcd542059cfd780cab7fed93) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:14:51.818072 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b0f50-90c0-4545-989b-b9ee01942bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:51.818072 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b0f50-90c0-4545-989b-b9ee01942bcb None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:51.824700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 12/21] 10.222.0.59 () {56 vars in 1322 bytes} [Thu Jun 2 14:14:51 2022] GET /identity/v3/role_assignments?user.id=178ae9fcbcd542059cfd780cab7fed93&scope.domain.id=default&role.id=61482861f00e45048fc1d45570c4c99b => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:54.735437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb61e26-2963-46cf-ae1e-e92b0c1852f7 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:54.735980 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb61e26-2963-46cf-ae1e-e92b0c1852f7 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:54.736252 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb61e26-2963-46cf-ae1e-e92b0c1852f7 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:54.737836 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 10/22] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:14:54.743360 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70951a72-f4ea-4ea5-9968-25e6285fd12f None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:54.743813 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70951a72-f4ea-4ea5-9968-25e6285fd12f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:54.744002 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70951a72-f4ea-4ea5-9968-25e6285fd12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:54.766806 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-70951a72-f4ea-4ea5-9968-25e6285fd12f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:54.768225 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-70951a72-f4ea-4ea5-9968-25e6285fd12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:54.771603 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340503a-4ccc-429f-9685-646f4b18ae03 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:54.771891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340503a-4ccc-429f-9685-646f4b18ae03 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:54.772170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340503a-4ccc-429f-9685-646f4b18ae03 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:54.773527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 11/23] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:14:54.780856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408aeb-5a43-4bc3-9d29-acf9ba6f2c07 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:54.781148 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408aeb-5a43-4bc3-9d29-acf9ba6f2c07 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:54.781429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408aeb-5a43-4bc3-9d29-acf9ba6f2c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:54.804987 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-ce408aeb-5a43-4bc3-9d29-acf9ba6f2c07 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:54.806206 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-ce408aeb-5a43-4bc3-9d29-acf9ba6f2c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:54.943908 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 13/24] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:14:54.945593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 12/25] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:14:54.962854 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f931d-2011-443a-b34a-9ab6c893adfc None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:54.963150 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f931d-2011-443a-b34a-9ab6c893adfc None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:54.963432 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f931d-2011-443a-b34a-9ab6c893adfc None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:54.965024 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 14/26] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:14:54.970790 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8eadb-874c-44f5-be6c-337aa2efdb58 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:54.971277 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8eadb-874c-44f5-be6c-337aa2efdb58 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:54.971745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8eadb-874c-44f5-be6c-337aa2efdb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:54.975756 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f931d-2011-443a-b34a-9ab6c893adfc None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:55.004677 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-46a8eadb-874c-44f5-be6c-337aa2efdb58 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:55.004677 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-46a8eadb-874c-44f5-be6c-337aa2efdb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:55.057622 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:55.099826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 13/27] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:14:55.100684 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8eadb-874c-44f5-be6c-337aa2efdb58 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:55.102070 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:55.130691 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f931d-2011-443a-b34a-9ab6c893adfc None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:55.167754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238bd93-b963-4d89-8720-7a20fdb3e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:55.168430 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238bd93-b963-4d89-8720-7a20fdb3e29a None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:55.168718 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238bd93-b963-4d89-8720-7a20fdb3e29a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:55.168998 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238bd93-b963-4d89-8720-7a20fdb3e29a None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:55.169817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238bd93-b963-4d89-8720-7a20fdb3e29a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:55.171330 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238bd93-b963-4d89-8720-7a20fdb3e29a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:55.208688 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8eadb-874c-44f5-be6c-337aa2efdb58 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:55.246588 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45825fd-99e1-4c51-9efc-7c1ec7dd9c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:55.247534 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45825fd-99e1-4c51-9efc-7c1ec7dd9c21 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:55.248337 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45825fd-99e1-4c51-9efc-7c1ec7dd9c21 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:55.248617 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45825fd-99e1-4c51-9efc-7c1ec7dd9c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:55.259761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45825fd-99e1-4c51-9efc-7c1ec7dd9c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:55.261237 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45825fd-99e1-4c51-9efc-7c1ec7dd9c21 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-d45825fd-99e1-4c51-9efc-7c1ec7dd9c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:14:55.280470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:14:55.286067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:14:55.286889 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:14:55.286889 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:14:55.286889 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:14:55.286889 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:14:55.286889 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 14/28] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:14:55.288056 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edbec6-ae57-4685-b662-d4526715e0b2 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:55.288348 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edbec6-ae57-4685-b662-d4526715e0b2 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:55.288635 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edbec6-ae57-4685-b662-d4526715e0b2 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:55.290132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 15/29] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:14:55.294345 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edbec6-ae57-4685-b662-d4526715e0b2 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:55.331227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:55.406446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 15/30] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 2 14:14:54 2022] POST /identity/v3/roles => generated 219 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:14:55.407804 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238bd93-b963-4d89-8720-7a20fdb3e29a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:55.424328 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edbec6-ae57-4685-b662-d4526715e0b2 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:55.511874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b471-282e-49dc-8938-f45e8e99c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:55.513189 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b471-282e-49dc-8938-f45e8e99c83e None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:55.515601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b471-282e-49dc-8938-f45e8e99c83e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:55.516128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b471-282e-49dc-8938-f45e8e99c83e None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:55.517124 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b471-282e-49dc-8938-f45e8e99c83e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:55.519339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b471-282e-49dc-8938-f45e8e99c83e None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:55.587253 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238bd93-b963-4d89-8720-7a20fdb3e29a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:55.647800 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f8aa2-f509-450d-a147-25ef231ee875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:55.648543 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f8aa2-f509-450d-a147-25ef231ee875 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:55.648833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f8aa2-f509-450d-a147-25ef231ee875 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:55.649114 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f8aa2-f509-450d-a147-25ef231ee875 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:55.649913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f8aa2-f509-450d-a147-25ef231ee875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:14:55.650227 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f8aa2-f509-450d-a147-25ef231ee875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:55.651970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f8aa2-f509-450d-a147-25ef231ee875 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:55.655052 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:55.679043 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 16/31] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:14:55.681153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db630cb-2567-4344-9e39-748fe7d91b09 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:55.686826 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db630cb-2567-4344-9e39-748fe7d91b09 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:55.686826 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db630cb-2567-4344-9e39-748fe7d91b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:55.709176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-8db630cb-2567-4344-9e39-748fe7d91b09 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:55.711206 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-8db630cb-2567-4344-9e39-748fe7d91b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:55.754157 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 16/32] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 2 14:14:55 2022] POST /identity/v3/roles => generated 225 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:14:55.755310 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b471-282e-49dc-8938-f45e8e99c83e None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:55.828174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 17/33] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:14:55.868779 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:55.869752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db630cb-2567-4344-9e39-748fe7d91b09 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:55.876510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b471-282e-49dc-8938-f45e8e99c83e None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:55.918086 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca73e61-cde1-405a-9c4a-c908fc6e825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:55.919003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca73e61-cde1-405a-9c4a-c908fc6e825c None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:55.919367 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca73e61-cde1-405a-9c4a-c908fc6e825c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:55.919818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca73e61-cde1-405a-9c4a-c908fc6e825c None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:55.921368 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca73e61-cde1-405a-9c4a-c908fc6e825c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:55.923159 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca73e61-cde1-405a-9c4a-c908fc6e825c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:56.030403 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db630cb-2567-4344-9e39-748fe7d91b09 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:56.059089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:56.071304 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70964510-9e76-42a4-b2ac-c027cf8d3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:56.072111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964510-9e76-42a4-b2ac-c027cf8d3371 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.072398 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964510-9e76-42a4-b2ac-c027cf8d3371 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.072676 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964510-9e76-42a4-b2ac-c027cf8d3371 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.090758 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70964510-9e76-42a4-b2ac-c027cf8d3371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-70964510-9e76-42a4-b2ac-c027cf8d3371 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:14:56.093931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:14:56.095058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:14:56.095810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:14:56.096465 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 17/34] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 14:14:55 2022] POST /identity/v3/projects => generated 301 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:14:56.096542 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 18/35] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:14:56.096607 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c1a97-43d3-48bb-a31a-29a66c64dd40 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.096607 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c1a97-43d3-48bb-a31a-29a66c64dd40 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.097111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c1a97-43d3-48bb-a31a-29a66c64dd40 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.098309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 18/36] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:14:56.101412 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70964510-9e76-42a4-b2ac-c027cf8d3371 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:56.108234 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4f986-4034-402b-ba86-ef3f7589294d None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.108581 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4f986-4034-402b-ba86-ef3f7589294d None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.108812 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4f986-4034-402b-ba86-ef3f7589294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.136709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-5fb4f986-4034-402b-ba86-ef3f7589294d None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:56.140791 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-5fb4f986-4034-402b-ba86-ef3f7589294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:56.250744 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 19/37] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:14:56.256329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70964510-9e76-42a4-b2ac-c027cf8d3371 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:56.278854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4f986-4034-402b-ba86-ef3f7589294d None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:56.306177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba47aa-8171-4fd8-a1af-87badaad241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:56.307243 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba47aa-8171-4fd8-a1af-87badaad241d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.307533 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba47aa-8171-4fd8-a1af-87badaad241d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.307816 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba47aa-8171-4fd8-a1af-87badaad241d None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.309096 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba47aa-8171-4fd8-a1af-87badaad241d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:14:56.309418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba47aa-8171-4fd8-a1af-87badaad241d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:56.311483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba47aa-8171-4fd8-a1af-87badaad241d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:56.324490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 19/38] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:14:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:14:56.330821 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba47aa-8171-4fd8-a1af-87badaad241d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:56.390085 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:56.392826 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:56.433475 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4f986-4034-402b-ba86-ef3f7589294d None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:56.461189 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba47aa-8171-4fd8-a1af-87badaad241d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:56.469264 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60747d9-8a3e-4c03-963b-109ae5ad553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:56.469941 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60747d9-8a3e-4c03-963b-109ae5ad553c None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.470323 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60747d9-8a3e-4c03-963b-109ae5ad553c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.470606 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60747d9-8a3e-4c03-963b-109ae5ad553c None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.471507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60747d9-8a3e-4c03-963b-109ae5ad553c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:56.473116 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60747d9-8a3e-4c03-963b-109ae5ad553c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:56.496970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad3b2d-2862-4d52-a25b-4e77739c1c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:56.498044 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad3b2d-2862-4d52-a25b-4e77739c1c14 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.498334 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad3b2d-2862-4d52-a25b-4e77739c1c14 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.498618 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad3b2d-2862-4d52-a25b-4e77739c1c14 None admin] PATH_INFO: `/v3/users/178ae9fcbcd542059cfd780cab7fed93` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.499872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad3b2d-2862-4d52-a25b-4e77739c1c14 None admin] RBAC: Authorizing `identity:get_user(user_id=178ae9fcbcd542059cfd780cab7fed93)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:56.501332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad3b2d-2862-4d52-a25b-4e77739c1c14 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:56.504172 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 20/39] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:14:56 2022] GET /identity/v3/users/178ae9fcbcd542059cfd780cab7fed93 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:14:56.509628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad3b2d-2862-4d52-a25b-4e77739c1c14 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:56.553014 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 20/40] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 2 14:14:56 2022] POST /identity/v3/roles => generated 223 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:14:56.596273 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aff9a3-304e-4d8d-8a78-b31d39f270da None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.596645 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aff9a3-304e-4d8d-8a78-b31d39f270da None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.596848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aff9a3-304e-4d8d-8a78-b31d39f270da None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.598273 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 21/41] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:14:56.605279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cd544-b099-440f-ab46-04069c5f680c None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.605279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cd544-b099-440f-ab46-04069c5f680c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.605279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cd544-b099-440f-ab46-04069c5f680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.622941 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-114cd544-b099-440f-ab46-04069c5f680c None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:56.624917 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-114cd544-b099-440f-ab46-04069c5f680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:56.637298 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad3b2d-2862-4d52-a25b-4e77739c1c14 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:56.652664 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:56.678709 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20eaac-010c-4d1a-913d-b54a4bafa15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:56.679544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20eaac-010c-4d1a-913d-b54a4bafa15d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.679833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20eaac-010c-4d1a-913d-b54a4bafa15d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.680114 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20eaac-010c-4d1a-913d-b54a4bafa15d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.681375 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20eaac-010c-4d1a-913d-b54a4bafa15d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:56.682991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20eaac-010c-4d1a-913d-b54a4bafa15d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:56.684698 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 21/42] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:14:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:56.690390 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20eaac-010c-4d1a-913d-b54a4bafa15d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:56.713382 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 22/43] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:14:56.739429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cd544-b099-440f-ab46-04069c5f680c None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:56.812416 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:56.813023 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20eaac-010c-4d1a-913d-b54a4bafa15d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:56.847394 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab7c0c-d15b-4d37-a246-86debac8a145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:56.848263 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab7c0c-d15b-4d37-a246-86debac8a145 None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.848548 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab7c0c-d15b-4d37-a246-86debac8a145 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.848828 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab7c0c-d15b-4d37-a246-86debac8a145 None admin] PATH_INFO: `/v3/domains/default/users/178ae9fcbcd542059cfd780cab7fed93/roles/61482861f00e45048fc1d45570c4c99b` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.851063 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab7c0c-d15b-4d37-a246-86debac8a145 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=178ae9fcbcd542059cfd780cab7fed93, role_id=61482861f00e45048fc1d45570c4c99b)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:56.852541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab7c0c-d15b-4d37-a246-86debac8a145 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:56.853186 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cd544-b099-440f-ab46-04069c5f680c None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:56.887810 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b2520-fbd2-4207-8492-cb2f9e88b366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:56.889326 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2520-fbd2-4207-8492-cb2f9e88b366 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:56.889616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2520-fbd2-4207-8492-cb2f9e88b366 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:56.889920 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2520-fbd2-4207-8492-cb2f9e88b366 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:56.891157 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b2520-fbd2-4207-8492-cb2f9e88b366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:56.892630 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b2520-fbd2-4207-8492-cb2f9e88b366 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:56.894244 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 23/44] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:14:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:56.899746 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b2520-fbd2-4207-8492-cb2f9e88b366 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:56.927991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 22/45] 10.222.0.59 () {58 vars in 1361 bytes} [Thu Jun 2 14:14:56 2022] PUT /identity/v3/domains/default/users/178ae9fcbcd542059cfd780cab7fed93/roles/61482861f00e45048fc1d45570c4c99b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:14:57.005904 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b2520-fbd2-4207-8492-cb2f9e88b366 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:57.035100 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:57.043155 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51ae95-6f7a-4f70-b979-d85529d7ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:57.043833 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51ae95-6f7a-4f70-b979-d85529d7ede2 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:57.044170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51ae95-6f7a-4f70-b979-d85529d7ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:57.044447 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51ae95-6f7a-4f70-b979-d85529d7ede2 None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:57.051154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51ae95-6f7a-4f70-b979-d85529d7ede2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:57.051154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51ae95-6f7a-4f70-b979-d85529d7ede2 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:57.145592 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 14:14:56 2022] POST /identity/v3/projects => generated 312 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:14:59.256885 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e934f-0fe6-46ad-a9b9-c5bfc3d474fb None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:59.257390 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e934f-0fe6-46ad-a9b9-c5bfc3d474fb None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:59.257390 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e934f-0fe6-46ad-a9b9-c5bfc3d474fb None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:59.258729 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 23/47] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:14:59.264617 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbf3cb-5d11-4939-b950-8629a9b1c2b7 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:59.265030 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbf3cb-5d11-4939-b950-8629a9b1c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:59.265243 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbf3cb-5d11-4939-b950-8629a9b1c2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:59.282450 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-b7cbf3cb-5d11-4939-b950-8629a9b1c2b7 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:59.283663 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-b7cbf3cb-5d11-4939-b950-8629a9b1c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:59.348984 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 25/48] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:14:59.372946 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e934f-0fe6-46ad-a9b9-c5bfc3d474fb None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:59.417714 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:59.463243 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebfce-e453-4055-8601-bdaddfc78605 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:59.463544 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebfce-e453-4055-8601-bdaddfc78605 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:59.463829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebfce-e453-4055-8601-bdaddfc78605 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:59.465224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 26/49] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:14:59.470923 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9810a74-fefc-4365-ab18-33461dcb41f1 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:59.471217 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9810a74-fefc-4365-ab18-33461dcb41f1 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:59.471501 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9810a74-fefc-4365-ab18-33461dcb41f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:59.475276 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e934f-0fe6-46ad-a9b9-c5bfc3d474fb None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:59.488227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-a9810a74-fefc-4365-ab18-33461dcb41f1 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:59.489591 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-a9810a74-fefc-4365-ab18-33461dcb41f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:59.509462 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982b422-d5f5-48f7-abab-27c6a16992f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:59.510251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982b422-d5f5-48f7-abab-27c6a16992f2 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:59.510749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982b422-d5f5-48f7-abab-27c6a16992f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:59.511043 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982b422-d5f5-48f7-abab-27c6a16992f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:59.522220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982b422-d5f5-48f7-abab-27c6a16992f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-6982b422-d5f5-48f7-abab-27c6a16992f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:14:59.530464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:14:59.531447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:14:59.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 24/50] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:14:59.537436 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982b422-d5f5-48f7-abab-27c6a16992f2 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:59.558572 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 27/51] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:14:59.583038 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9810a74-fefc-4365-ab18-33461dcb41f1 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:59.624334 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:59.639622 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982b422-d5f5-48f7-abab-27c6a16992f2 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:59.641151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:59.673209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50045693-5060-4d9d-ac54-9d3ded76a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:59.673880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50045693-5060-4d9d-ac54-9d3ded76a541 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:59.674169 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50045693-5060-4d9d-ac54-9d3ded76a541 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:59.674451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50045693-5060-4d9d-ac54-9d3ded76a541 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:59.675278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50045693-5060-4d9d-ac54-9d3ded76a541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:14:59.675549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50045693-5060-4d9d-ac54-9d3ded76a541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:59.676951 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50045693-5060-4d9d-ac54-9d3ded76a541 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:59.681391 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9810a74-fefc-4365-ab18-33461dcb41f1 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:59.685168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 25/52] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:59.692560 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50045693-5060-4d9d-ac54-9d3ded76a541 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:59.716213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145715f-ba14-40e4-83d1-b6a4f9d18c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:59.717531 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145715f-ba14-40e4-83d1-b6a4f9d18c7c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:59.717816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145715f-ba14-40e4-83d1-b6a4f9d18c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:59.718094 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145715f-ba14-40e4-83d1-b6a4f9d18c7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:59.719419 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145715f-ba14-40e4-83d1-b6a4f9d18c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:59.720891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145715f-ba14-40e4-83d1-b6a4f9d18c7c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:59.722690 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 28/53] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:14:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:59.728246 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145715f-ba14-40e4-83d1-b6a4f9d18c7c None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:59.794190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50045693-5060-4d9d-ac54-9d3ded76a541 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:59.828332 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145715f-ba14-40e4-83d1-b6a4f9d18c7c None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:59.829052 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d83fc-5471-4ce2-b252-5ba590c49eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:59.829937 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d83fc-5471-4ce2-b252-5ba590c49eb9 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:59.830223 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d83fc-5471-4ce2-b252-5ba590c49eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:59.830494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d83fc-5471-4ce2-b252-5ba590c49eb9 None admin] PATH_INFO: `/v3/users/178ae9fcbcd542059cfd780cab7fed93` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:59.831766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d83fc-5471-4ce2-b252-5ba590c49eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=178ae9fcbcd542059cfd780cab7fed93)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:59.833249 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d83fc-5471-4ce2-b252-5ba590c49eb9 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:59.834920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 26/54] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:14:59 2022] GET /identity/v3/users/178ae9fcbcd542059cfd780cab7fed93 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:59.838032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:59.840219 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d83fc-5471-4ce2-b252-5ba590c49eb9 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:59.864467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db12b1-1588-4ad8-bff8-00a960919dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:59.865132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db12b1-1588-4ad8-bff8-00a960919dcc None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:59.865428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db12b1-1588-4ad8-bff8-00a960919dcc None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:59.865711 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db12b1-1588-4ad8-bff8-00a960919dcc None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:59.866423 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db12b1-1588-4ad8-bff8-00a960919dcc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:59.867923 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db12b1-1588-4ad8-bff8-00a960919dcc None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:59.872258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:59.940575 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d83fc-5471-4ce2-b252-5ba590c49eb9 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:59.973738 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769e9d-fe0d-4e16-b37b-a518f3fc4443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:59.974542 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769e9d-fe0d-4e16-b37b-a518f3fc4443 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:59.974864 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769e9d-fe0d-4e16-b37b-a518f3fc4443 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:59.975147 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769e9d-fe0d-4e16-b37b-a518f3fc4443 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:59.975281 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 29/55] 10.222.0.59 () {60 vars in 1140 bytes} [Thu Jun 2 14:14:59 2022] POST /identity/v3/projects => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:14:59.976388 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc769e9d-fe0d-4e16-b37b-a518f3fc4443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:59.977918 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc769e9d-fe0d-4e16-b37b-a518f3fc4443 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:59.979613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 27/56] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:14:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:14:59.986239 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db12b1-1588-4ad8-bff8-00a960919dcc None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:00.095672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db12b1-1588-4ad8-bff8-00a960919dcc None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:00.132856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14eb2a-9b90-4fe0-b37b-af8cc6d1067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:00.133536 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14eb2a-9b90-4fe0-b37b-af8cc6d1067f None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:00.133822 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14eb2a-9b90-4fe0-b37b-af8cc6d1067f None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:00.134103 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14eb2a-9b90-4fe0-b37b-af8cc6d1067f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:00.135010 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14eb2a-9b90-4fe0-b37b-af8cc6d1067f None admin] RBAC: Adding query filter params (role.id=61482861f00e45048fc1d45570c4c99b, scope.domain.id=default, user.id=178ae9fcbcd542059cfd780cab7fed93) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:00.135403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14eb2a-9b90-4fe0-b37b-af8cc6d1067f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:00.136917 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14eb2a-9b90-4fe0-b37b-af8cc6d1067f None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:00.147644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 30/57] 10.222.0.59 () {56 vars in 1322 bytes} [Thu Jun 2 14:14:59 2022] GET /identity/v3/role_assignments?user.id=178ae9fcbcd542059cfd780cab7fed93&scope.domain.id=default&role.id=61482861f00e45048fc1d45570c4c99b => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:02.319729 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029f83-9727-4cf7-8661-8b9e0274a9a0 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:02.320220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029f83-9727-4cf7-8661-8b9e0274a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:02.320220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae029f83-9727-4cf7-8661-8b9e0274a9a0 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:02.321583 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 28/58] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:02.327290 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb7008-aba6-4007-95e9-821fc3ef7fb3 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:02.327690 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb7008-aba6-4007-95e9-821fc3ef7fb3 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:02.327855 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb7008-aba6-4007-95e9-821fc3ef7fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:02.345210 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-76cb7008-aba6-4007-95e9-821fc3ef7fb3 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:02.346406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-76cb7008-aba6-4007-95e9-821fc3ef7fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:02.363421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:02.411955 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 31/59] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:02.438820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae029f83-9727-4cf7-8661-8b9e0274a9a0 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:02.533437 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:02.537072 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae029f83-9727-4cf7-8661-8b9e0274a9a0 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:02.571098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bd018-8c7a-458a-9b4c-8c1e7dfb09b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:02.571806 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd018-8c7a-458a-9b4c-8c1e7dfb09b2 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:02.572089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd018-8c7a-458a-9b4c-8c1e7dfb09b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:02.572366 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd018-8c7a-458a-9b4c-8c1e7dfb09b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:02.573527 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bd018-8c7a-458a-9b4c-8c1e7dfb09b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:02.575003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bd018-8c7a-458a-9b4c-8c1e7dfb09b2 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:02.576752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 29/60] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:02.582286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb7008-aba6-4007-95e9-821fc3ef7fb3 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:02.682085 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb7008-aba6-4007-95e9-821fc3ef7fb3 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:02.714322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025872cb-93df-494f-a914-4038e711f7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:02.715018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025872cb-93df-494f-a914-4038e711f7c5 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:02.715308 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025872cb-93df-494f-a914-4038e711f7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:02.715591 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025872cb-93df-494f-a914-4038e711f7c5 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:02.716308 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025872cb-93df-494f-a914-4038e711f7c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:02.718455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025872cb-93df-494f-a914-4038e711f7c5 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:02.828133 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 32/61] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:15:02 2022] POST /identity/v3/users => generated 275 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:15:06.285517 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeb217-2b72-4fce-9d53-df7ad73e929d None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:06.310460 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeb217-2b72-4fce-9d53-df7ad73e929d None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:06.310460 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeb217-2b72-4fce-9d53-df7ad73e929d None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:06.310460 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 30/62] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:06.310981 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147cd7-51e3-415d-ad96-e487b1e852d7 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:06.310981 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147cd7-51e3-415d-ad96-e487b1e852d7 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:06.310981 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7147cd7-51e3-415d-ad96-e487b1e852d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:06.324814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-b7147cd7-51e3-415d-ad96-e487b1e852d7 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:06.326572 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-b7147cd7-51e3-415d-ad96-e487b1e852d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:06.336225 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:06.424329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 33/63] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:06.466492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeb217-2b72-4fce-9d53-df7ad73e929d None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:06.619334 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeb217-2b72-4fce-9d53-df7ad73e929d None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:06.662789 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676be11-d911-45df-8214-4701509cde04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:06.663599 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676be11-d911-45df-8214-4701509cde04 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:06.663886 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676be11-d911-45df-8214-4701509cde04 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:06.664164 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676be11-d911-45df-8214-4701509cde04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:06.668865 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70cac8-7e0a-4ca2-8256-683c9fb32ef2 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:06.669415 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70cac8-7e0a-4ca2-8256-683c9fb32ef2 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:06.670609 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70cac8-7e0a-4ca2-8256-683c9fb32ef2 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:06.672479 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 34/64] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:06.683750 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee4eca-47c2-430b-ab21-770b801c153f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:06.684578 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee4eca-47c2-430b-ab21-770b801c153f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:06.685067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee4eca-47c2-430b-ab21-770b801c153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:06.687840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676be11-d911-45df-8214-4701509cde04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-5676be11-d911-45df-8214-4701509cde04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:06.696204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:06.697144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:06.697928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 31/65] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:06.705691 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676be11-d911-45df-8214-4701509cde04 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:06.727805 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-66ee4eca-47c2-430b-ab21-770b801c153f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:06.729432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-66ee4eca-47c2-430b-ab21-770b801c153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:06.757712 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:06.810578 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 35/66] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:06.812015 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1769-ed12-40fd-8871-ff442ac407bd None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:06.812315 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1769-ed12-40fd-8871-ff442ac407bd None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:06.812604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1769-ed12-40fd-8871-ff442ac407bd None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:06.813891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 36/67] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:06.819119 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1247f-a0e4-4bbd-9cbb-a5f198342814 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:06.819598 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1247f-a0e4-4bbd-9cbb-a5f198342814 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:06.820038 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1247f-a0e4-4bbd-9cbb-a5f198342814 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:06.821541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 37/68] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:06.822837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f871716-3787-4644-a26e-f2831e09596a None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:06.823367 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f871716-3787-4644-a26e-f2831e09596a None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:06.823858 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f871716-3787-4644-a26e-f2831e09596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:06.841247 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676be11-d911-45df-8214-4701509cde04 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:06.855589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-7f871716-3787-4644-a26e-f2831e09596a None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:06.857638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-7f871716-3787-4644-a26e-f2831e09596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:06.876660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6c096-58c6-4b0f-b163-0e70143cf7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:06.877264 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c096-58c6-4b0f-b163-0e70143cf7c6 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:06.877554 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c096-58c6-4b0f-b163-0e70143cf7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:06.877838 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6c096-58c6-4b0f-b163-0e70143cf7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:06.878595 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6c096-58c6-4b0f-b163-0e70143cf7c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:06.879628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6c096-58c6-4b0f-b163-0e70143cf7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:06.881036 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6c096-58c6-4b0f-b163-0e70143cf7c6 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:06.890361 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 32/69] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:06.891523 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3d6df-ba89-476a-8659-7aebd06c40d9 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:06.891815 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3d6df-ba89-476a-8659-7aebd06c40d9 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:06.892097 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3d6df-ba89-476a-8659-7aebd06c40d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:06.912151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-51c3d6df-ba89-476a-8659-7aebd06c40d9 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:06.913345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-51c3d6df-ba89-476a-8659-7aebd06c40d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:06.941352 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:06.946348 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 38/70] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:06.947378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f871716-3787-4644-a26e-f2831e09596a None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:06.996310 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 33/71] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:06.997240 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3d6df-ba89-476a-8659-7aebd06c40d9 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.032068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:07.062769 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f871716-3787-4644-a26e-f2831e09596a None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.099646 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bc5d9-f929-4948-891a-c00294136af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.100473 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bc5d9-f929-4948-891a-c00294136af4 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.100760 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bc5d9-f929-4948-891a-c00294136af4 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.101037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bc5d9-f929-4948-891a-c00294136af4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.112916 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bc5d9-f929-4948-891a-c00294136af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:07.116130 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3d6df-ba89-476a-8659-7aebd06c40d9 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-f31bc5d9-f929-4948-891a-c00294136af4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:07.122102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:07.128144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 39/72] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:07.129164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bc5d9-f929-4948-891a-c00294136af4 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.153595 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbfc9e-304e-4749-ab27-5475be0691ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.156616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbfc9e-304e-4749-ab27-5475be0691ca None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.156905 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbfc9e-304e-4749-ab27-5475be0691ca None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.157194 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbfc9e-304e-4749-ab27-5475be0691ca None admin] PATH_INFO: `/v3/users/1ffb3d4925534295a000d01ee5969114` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.170777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbfc9e-304e-4749-ab27-5475be0691ca None admin] RBAC: Authorizing `identity:get_user(user_id=1ffb3d4925534295a000d01ee5969114)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:07.172320 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbfc9e-304e-4749-ab27-5475be0691ca None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:07.174039 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 34/73] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:06 2022] GET /identity/v3/users/1ffb3d4925534295a000d01ee5969114 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:07.174847 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbfc9e-304e-4749-ab27-5475be0691ca None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.195946 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:07.236908 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bc5d9-f929-4948-891a-c00294136af4 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.251774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:07.272458 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe2dc8-6193-4391-813f-19b5d01e5b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.273258 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2dc8-6193-4391-813f-19b5d01e5b5a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.273542 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2dc8-6193-4391-813f-19b5d01e5b5a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.273641 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbfc9e-304e-4749-ab27-5475be0691ca None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.273821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2dc8-6193-4391-813f-19b5d01e5b5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.285660 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe2dc8-6193-4391-813f-19b5d01e5b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-18fe2dc8-6193-4391-813f-19b5d01e5b5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:07.293441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:07.294270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:07.295235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 40/74] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:07.296303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041ec32-5c3d-4430-adda-b76cd9f648b2 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.296576 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041ec32-5c3d-4430-adda-b76cd9f648b2 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.297009 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041ec32-5c3d-4430-adda-b76cd9f648b2 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.298436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 41/75] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:07.303225 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041ec32-5c3d-4430-adda-b76cd9f648b2 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.309262 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385713de-ea80-435d-9b0d-ee2fed3220db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.310745 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385713de-ea80-435d-9b0d-ee2fed3220db None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.311100 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385713de-ea80-435d-9b0d-ee2fed3220db None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.311414 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385713de-ea80-435d-9b0d-ee2fed3220db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.321615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385713de-ea80-435d-9b0d-ee2fed3220db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-385713de-ea80-435d-9b0d-ee2fed3220db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:07.330177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:07.331192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:07.332186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 35/76] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:07.333005 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385713de-ea80-435d-9b0d-ee2fed3220db None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.409866 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041ec32-5c3d-4430-adda-b76cd9f648b2 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.429709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:07.433126 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385713de-ea80-435d-9b0d-ee2fed3220db None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.444051 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483082e-d5f4-488a-9697-793d0a41f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.444741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483082e-d5f4-488a-9697-793d0a41f2ab None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.445025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483082e-d5f4-488a-9697-793d0a41f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.445301 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483082e-d5f4-488a-9697-793d0a41f2ab None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.446044 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483082e-d5f4-488a-9697-793d0a41f2ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:07.446353 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483082e-d5f4-488a-9697-793d0a41f2ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:07.447784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483082e-d5f4-488a-9697-793d0a41f2ab None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:07.459928 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 42/77] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:07.462478 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483082e-d5f4-488a-9697-793d0a41f2ab None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.468056 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c52c5a-d498-416c-a476-b375107b8f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.468712 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c52c5a-d498-416c-a476-b375107b8f3f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.469004 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c52c5a-d498-416c-a476-b375107b8f3f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.469295 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c52c5a-d498-416c-a476-b375107b8f3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.477962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:07.538708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c52c5a-d498-416c-a476-b375107b8f3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:07.540208 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c52c5a-d498-416c-a476-b375107b8f3f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:07.563326 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483082e-d5f4-488a-9697-793d0a41f2ab None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.596147 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c3eee-9c57-452e-9e40-372980010225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.596812 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c3eee-9c57-452e-9e40-372980010225 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.597104 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c3eee-9c57-452e-9e40-372980010225 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.597388 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c3eee-9c57-452e-9e40-372980010225 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.598140 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c3eee-9c57-452e-9e40-372980010225 None admin] RBAC: Adding query filter params (name=member) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:07.598461 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c3eee-9c57-452e-9e40-372980010225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:07.599898 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c3eee-9c57-452e-9e40-372980010225 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:07.608696 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 43/78] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:07.609700 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7fc88-f24a-478e-a359-657ee8d0e790 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.609995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7fc88-f24a-478e-a359-657ee8d0e790 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.610281 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7fc88-f24a-478e-a359-657ee8d0e790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.626592 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-faf7fc88-f24a-478e-a359-657ee8d0e790 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:07.627838 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-faf7fc88-f24a-478e-a359-657ee8d0e790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:07.644176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 36/79] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:07.645022 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c52c5a-d498-416c-a476-b375107b8f3f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.675412 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:07.686367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:07.701262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 44/80] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:07.702112 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7fc88-f24a-478e-a359-657ee8d0e790 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.762591 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c52c5a-d498-416c-a476-b375107b8f3f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.797327 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2ed7-183a-4fb7-929c-3930719efa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.797987 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2ed7-183a-4fb7-929c-3930719efa63 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.798270 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2ed7-183a-4fb7-929c-3930719efa63 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.798557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2ed7-183a-4fb7-929c-3930719efa63 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.799325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f2ed7-183a-4fb7-929c-3930719efa63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:07.799634 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f2ed7-183a-4fb7-929c-3930719efa63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:07.801132 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f2ed7-183a-4fb7-929c-3930719efa63 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:07.802895 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7fc88-f24a-478e-a359-657ee8d0e790 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.809509 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 37/81] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:07.810385 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2ed7-183a-4fb7-929c-3930719efa63 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.838186 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f97a60-0372-4b55-925c-4f6be441c9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.839096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f97a60-0372-4b55-925c-4f6be441c9c5 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.839387 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f97a60-0372-4b55-925c-4f6be441c9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.839667 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f97a60-0372-4b55-925c-4f6be441c9c5 None admin] PATH_INFO: `/v3/users/178ae9fcbcd542059cfd780cab7fed93` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.841104 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f97a60-0372-4b55-925c-4f6be441c9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=178ae9fcbcd542059cfd780cab7fed93)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:07.843316 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f97a60-0372-4b55-925c-4f6be441c9c5 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:07.844964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 45/82] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/users/178ae9fcbcd542059cfd780cab7fed93 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:07.845768 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f97a60-0372-4b55-925c-4f6be441c9c5 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.892315 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:07.909063 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:07.911960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f2ed7-183a-4fb7-929c-3930719efa63 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.945765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dedd0-7c84-4dbb-8007-aaecf889d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.945969 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dedd0-7c84-4dbb-8007-aaecf889d81d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.946161 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dedd0-7c84-4dbb-8007-aaecf889d81d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.946420 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dedd0-7c84-4dbb-8007-aaecf889d81d None admin] PATH_INFO: `/v3/users/1ffb3d4925534295a000d01ee5969114` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.947721 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dedd0-7c84-4dbb-8007-aaecf889d81d None admin] RBAC: Authorizing `identity:get_user(user_id=1ffb3d4925534295a000d01ee5969114)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:07.949172 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dedd0-7c84-4dbb-8007-aaecf889d81d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:07.949285 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f97a60-0372-4b55-925c-4f6be441c9c5 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:07.951548 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 38/83] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/users/1ffb3d4925534295a000d01ee5969114 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:07.954267 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dedd0-7c84-4dbb-8007-aaecf889d81d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:07.986464 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e90e3-8871-4769-959f-7e46a924155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:07.987368 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e90e3-8871-4769-959f-7e46a924155e None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:07.987657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e90e3-8871-4769-959f-7e46a924155e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:07.987932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e90e3-8871-4769-959f-7e46a924155e None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:07.989137 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e90e3-8871-4769-959f-7e46a924155e None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:07.990612 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e90e3-8871-4769-959f-7e46a924155e None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:07.992349 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 46/84] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:07.993110 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e90e3-8871-4769-959f-7e46a924155e None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:08.057056 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dedd0-7c84-4dbb-8007-aaecf889d81d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:08.093572 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e90e3-8871-4769-959f-7e46a924155e None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:08.094433 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db373b-14f3-4f63-bd5b-7b06eba6eca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:08.095265 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db373b-14f3-4f63-bd5b-7b06eba6eca9 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:08.095549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db373b-14f3-4f63-bd5b-7b06eba6eca9 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:08.095838 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db373b-14f3-4f63-bd5b-7b06eba6eca9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:08.100102 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db373b-14f3-4f63-bd5b-7b06eba6eca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:08.101463 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db373b-14f3-4f63-bd5b-7b06eba6eca9 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:08.103856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:08.105944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 39/85] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:08.106756 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db373b-14f3-4f63-bd5b-7b06eba6eca9 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:08.128806 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9d640-c048-4554-a760-e69b7906d780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:08.130232 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9d640-c048-4554-a760-e69b7906d780 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:08.130562 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9d640-c048-4554-a760-e69b7906d780 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:08.130882 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9d640-c048-4554-a760-e69b7906d780 None admin] PATH_INFO: `/v3/users/1ffb3d4925534295a000d01ee5969114` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:08.132106 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9d640-c048-4554-a760-e69b7906d780 None admin] RBAC: Authorizing `identity:get_user(user_id=1ffb3d4925534295a000d01ee5969114)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:08.133568 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9d640-c048-4554-a760-e69b7906d780 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:08.135256 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 47/86] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:07 2022] GET /identity/v3/users/1ffb3d4925534295a000d01ee5969114 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:08.136027 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9d640-c048-4554-a760-e69b7906d780 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:08.148450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:08.214806 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db373b-14f3-4f63-bd5b-7b06eba6eca9 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:08.241757 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9d640-c048-4554-a760-e69b7906d780 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:08.249433 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e82e8-2044-4510-81b3-3cb7902deb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:08.250088 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e82e8-2044-4510-81b3-3cb7902deb60 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:08.250374 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e82e8-2044-4510-81b3-3cb7902deb60 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:08.250677 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e82e8-2044-4510-81b3-3cb7902deb60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:08.275879 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c3180-c7a4-4db0-b699-70f06bf72dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:08.276564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c3180-c7a4-4db0-b699-70f06bf72dd5 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:08.276858 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c3180-c7a4-4db0-b699-70f06bf72dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:08.277143 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c3180-c7a4-4db0-b699-70f06bf72dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:08.320773 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e82e8-2044-4510-81b3-3cb7902deb60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:08.322264 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e82e8-2044-4510-81b3-3cb7902deb60 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:08.324047 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:08.345347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c3180-c7a4-4db0-b699-70f06bf72dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:08.346848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c3180-c7a4-4db0-b699-70f06bf72dd5 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:08.355421 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:08.422549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 40/87] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:08.423432 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e82e8-2044-4510-81b3-3cb7902deb60 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:08.448845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 48/88] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:08.449670 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c3180-c7a4-4db0-b699-70f06bf72dd5 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:08.525815 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e82e8-2044-4510-81b3-3cb7902deb60 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:08.528529 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:08.550390 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c3180-c7a4-4db0-b699-70f06bf72dd5 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:08.560406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025459-d94e-4133-bb80-3328ff507076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:08.561065 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025459-d94e-4133-bb80-3328ff507076 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:08.561354 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025459-d94e-4133-bb80-3328ff507076 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:08.561632 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025459-d94e-4133-bb80-3328ff507076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:08.562459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025459-d94e-4133-bb80-3328ff507076 None admin] RBAC: Adding query filter params (role.id=3ce491f94839419ea9ba3b84324fcd8f, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9, user.id=1ffb3d4925534295a000d01ee5969114) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:08.562811 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025459-d94e-4133-bb80-3328ff507076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:08.564280 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025459-d94e-4133-bb80-3328ff507076 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:08.567538 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:08.570326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 41/89] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:08 2022] GET /identity/v3/role_assignments?user.id=1ffb3d4925534295a000d01ee5969114&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:08.571148 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025459-d94e-4133-bb80-3328ff507076 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:08.599841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc94bb-3609-4680-ac83-33bea3391b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:08.600841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc94bb-3609-4680-ac83-33bea3391b52 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:08.601140 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc94bb-3609-4680-ac83-33bea3391b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:08.601429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc94bb-3609-4680-ac83-33bea3391b52 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:08.602359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc94bb-3609-4680-ac83-33bea3391b52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:08.604658 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc94bb-3609-4680-ac83-33bea3391b52 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:08.682750 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025459-d94e-4133-bb80-3328ff507076 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:08.703056 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 49/90] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:15:08 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:15:08.703918 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc94bb-3609-4680-ac83-33bea3391b52 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:08.733584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400843d2-4d1c-45b2-ab09-f0cc6d95a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:08.734777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400843d2-4d1c-45b2-ab09-f0cc6d95a143 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:08.735460 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400843d2-4d1c-45b2-ab09-f0cc6d95a143 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:08.735971 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400843d2-4d1c-45b2-ab09-f0cc6d95a143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:08.828321 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400843d2-4d1c-45b2-ab09-f0cc6d95a143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:08.830317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400843d2-4d1c-45b2-ab09-f0cc6d95a143 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:08.833136 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:08.845917 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc94bb-3609-4680-ac83-33bea3391b52 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:08.904651 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f0b31-cf62-4442-ba84-011fdba234ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:08.905711 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f0b31-cf62-4442-ba84-011fdba234ad None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:08.906165 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f0b31-cf62-4442-ba84-011fdba234ad None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:08.906447 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f0b31-cf62-4442-ba84-011fdba234ad None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:08.908034 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f0b31-cf62-4442-ba84-011fdba234ad None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:08.910874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f0b31-cf62-4442-ba84-011fdba234ad None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:08.913626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 50/91] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:08 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:08.914248 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f0b31-cf62-4442-ba84-011fdba234ad None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:08.922931 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:08.978960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 42/92] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:08.979852 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400843d2-4d1c-45b2-ab09-f0cc6d95a143 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:09.058504 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f0b31-cf62-4442-ba84-011fdba234ad None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:09.109417 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79234f-12c2-4b73-89ec-f827afd4f8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:09.111710 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79234f-12c2-4b73-89ec-f827afd4f8c9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:09.111710 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79234f-12c2-4b73-89ec-f827afd4f8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:09.111710 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79234f-12c2-4b73-89ec-f827afd4f8c9 None admin] PATH_INFO: `/v3/projects/cd29d2e9470f41e3b1d390f9282a22b3` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:09.113689 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79234f-12c2-4b73-89ec-f827afd4f8c9 None admin] RBAC: Authorizing `identity:get_project(project_id=cd29d2e9470f41e3b1d390f9282a22b3)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:09.114888 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79234f-12c2-4b73-89ec-f827afd4f8c9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:09.115648 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:09.116696 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 51/93] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:08 2022] GET /identity/v3/projects/cd29d2e9470f41e3b1d390f9282a22b3 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:09.117175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79234f-12c2-4b73-89ec-f827afd4f8c9 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:09.124800 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400843d2-4d1c-45b2-ab09-f0cc6d95a143 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:09.183272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bd371-7cf5-4739-a7d8-f82ea69455aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:09.183970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bd371-7cf5-4739-a7d8-f82ea69455aa None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:09.184264 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bd371-7cf5-4739-a7d8-f82ea69455aa None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:09.184545 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bd371-7cf5-4739-a7d8-f82ea69455aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:09.186020 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bd371-7cf5-4739-a7d8-f82ea69455aa None admin] RBAC: Adding query filter params (role.id=61482861f00e45048fc1d45570c4c99b, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9, user.id=178ae9fcbcd542059cfd780cab7fed93) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:09.186378 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bd371-7cf5-4739-a7d8-f82ea69455aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:09.188364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bd371-7cf5-4739-a7d8-f82ea69455aa None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:09.195905 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 43/94] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:08 2022] GET /identity/v3/role_assignments?user.id=178ae9fcbcd542059cfd780cab7fed93&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=61482861f00e45048fc1d45570c4c99b => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:09.197211 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bd371-7cf5-4739-a7d8-f82ea69455aa None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:09.221463 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:09.260067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79234f-12c2-4b73-89ec-f827afd4f8c9 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:09.326573 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289140be-6213-4d44-b2e4-45132fb6cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:09.327888 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289140be-6213-4d44-b2e4-45132fb6cb9f None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:09.328381 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289140be-6213-4d44-b2e4-45132fb6cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:09.328855 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289140be-6213-4d44-b2e4-45132fb6cb9f None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:09.330306 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bd371-7cf5-4739-a7d8-f82ea69455aa None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:09.331033 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289140be-6213-4d44-b2e4-45132fb6cb9f None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:09.338665 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289140be-6213-4d44-b2e4-45132fb6cb9f None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:09.341430 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 52/95] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:09 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:09.364381 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289140be-6213-4d44-b2e4-45132fb6cb9f None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:09.377170 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dd818-37f8-4c67-8ac2-67e8dcba3650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:09.377847 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dd818-37f8-4c67-8ac2-67e8dcba3650 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:09.378140 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dd818-37f8-4c67-8ac2-67e8dcba3650 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:09.378424 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dd818-37f8-4c67-8ac2-67e8dcba3650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:09.379697 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dd818-37f8-4c67-8ac2-67e8dcba3650 None admin] RBAC: Adding query filter params (role.id=3ce491f94839419ea9ba3b84324fcd8f, scope.project.id=cd29d2e9470f41e3b1d390f9282a22b3, user.id=1ffb3d4925534295a000d01ee5969114) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:09.380020 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dd818-37f8-4c67-8ac2-67e8dcba3650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:09.381488 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dd818-37f8-4c67-8ac2-67e8dcba3650 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:09.388684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 44/96] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:09 2022] GET /identity/v3/role_assignments?user.id=1ffb3d4925534295a000d01ee5969114&scope.project.id=cd29d2e9470f41e3b1d390f9282a22b3&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:09.546579 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289140be-6213-4d44-b2e4-45132fb6cb9f None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:09.590845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a213b-e0ac-461b-82d4-a1e055f8d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:09.592557 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a213b-e0ac-461b-82d4-a1e055f8d738 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:09.593067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a213b-e0ac-461b-82d4-a1e055f8d738 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:09.593556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a213b-e0ac-461b-82d4-a1e055f8d738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:09.598671 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a213b-e0ac-461b-82d4-a1e055f8d738 None admin] RBAC: Adding query filter params (role.id=5782703fc53f48f28fb7015ae693cd60, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9, user.id=1ffb3d4925534295a000d01ee5969114) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:09.599578 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a213b-e0ac-461b-82d4-a1e055f8d738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:09.601447 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a213b-e0ac-461b-82d4-a1e055f8d738 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:09.609177 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 53/97] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:09 2022] GET /identity/v3/role_assignments?user.id=1ffb3d4925534295a000d01ee5969114&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=5782703fc53f48f28fb7015ae693cd60 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:11.516570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa4c18-b13c-4dac-8d33-2d78d5d57103 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:11.517602 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa4c18-b13c-4dac-8d33-2d78d5d57103 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:11.518116 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa4c18-b13c-4dac-8d33-2d78d5d57103 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:11.519746 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 45/98] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:15:11.525356 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eb636-7a04-45bc-a91c-2ee751baa06f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:11.526319 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eb636-7a04-45bc-a91c-2ee751baa06f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:11.526859 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eb636-7a04-45bc-a91c-2ee751baa06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:11.532851 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:11.546950 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-7c9eb636-7a04-45bc-a91c-2ee751baa06f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:11.548475 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-7c9eb636-7a04-45bc-a91c-2ee751baa06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:11.621010 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 54/99] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:11.646367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa4c18-b13c-4dac-8d33-2d78d5d57103 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:11.677272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:11.758003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa4c18-b13c-4dac-8d33-2d78d5d57103 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:11.796197 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15e53-1791-47f4-82b7-ea357117a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:11.797325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15e53-1791-47f4-82b7-ea357117a2ac None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:11.797842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15e53-1791-47f4-82b7-ea357117a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:11.798317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15e53-1791-47f4-82b7-ea357117a2ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:11.809732 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15e53-1791-47f4-82b7-ea357117a2ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-9cf15e53-1791-47f4-82b7-ea357117a2ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:11.818188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:11.823644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:11.824615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 46/100] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:15:11.827490 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9eb636-7a04-45bc-a91c-2ee751baa06f None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:11.942259 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9eb636-7a04-45bc-a91c-2ee751baa06f None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:11.973924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:11.979760 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537e7fa-2612-485f-b366-c9e313e8a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:11.980446 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537e7fa-2612-485f-b366-c9e313e8a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:11.980735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537e7fa-2612-485f-b366-c9e313e8a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:11.981016 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537e7fa-2612-485f-b366-c9e313e8a4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:11.981784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537e7fa-2612-485f-b366-c9e313e8a4b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:11.982797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537e7fa-2612-485f-b366-c9e313e8a4b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:11.984213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537e7fa-2612-485f-b366-c9e313e8a4b9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:11.993009 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 55/101] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:11.998904 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15e53-1791-47f4-82b7-ea357117a2ac None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:12.236938 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:12.250405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15e53-1791-47f4-82b7-ea357117a2ac None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:12.288109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536652bc-105c-4a33-9c27-ccaec1c11ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:12.289057 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536652bc-105c-4a33-9c27-ccaec1c11ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:12.289349 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536652bc-105c-4a33-9c27-ccaec1c11ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:12.289632 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536652bc-105c-4a33-9c27-ccaec1c11ae5 None admin] PATH_INFO: `/v3/users/1ffb3d4925534295a000d01ee5969114` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:12.290963 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536652bc-105c-4a33-9c27-ccaec1c11ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=1ffb3d4925534295a000d01ee5969114)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:12.292585 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536652bc-105c-4a33-9c27-ccaec1c11ae5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:12.298752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 47/102] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:11 2022] GET /identity/v3/users/1ffb3d4925534295a000d01ee5969114 => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:12.300370 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537e7fa-2612-485f-b366-c9e313e8a4b9 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:12.409324 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537e7fa-2612-485f-b366-c9e313e8a4b9 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:12.445541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7016e-41e5-4f0e-90e4-5237fbdde21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:12.446417 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7016e-41e5-4f0e-90e4-5237fbdde21a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:12.446744 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7016e-41e5-4f0e-90e4-5237fbdde21a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:12.447031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7016e-41e5-4f0e-90e4-5237fbdde21a None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:12.448272 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7016e-41e5-4f0e-90e4-5237fbdde21a None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:12.449751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7016e-41e5-4f0e-90e4-5237fbdde21a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:12.452652 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 56/103] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:12 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:12.458475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536652bc-105c-4a33-9c27-ccaec1c11ae5 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:12.567893 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536652bc-105c-4a33-9c27-ccaec1c11ae5 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:12.610910 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a91a7e-49c0-42b4-9139-2034a4f33c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:12.611820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a91a7e-49c0-42b4-9139-2034a4f33c2c None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:12.612111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a91a7e-49c0-42b4-9139-2034a4f33c2c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:12.612398 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a91a7e-49c0-42b4-9139-2034a4f33c2c None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/users/1ffb3d4925534295a000d01ee5969114/roles/3ce491f94839419ea9ba3b84324fcd8f` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:12.620348 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a91a7e-49c0-42b4-9139-2034a4f33c2c None admin] RBAC: Authorizing `identity:create_grant(project_id=0530adf9f8454784a3bdf6998c1fc7b9, user_id=1ffb3d4925534295a000d01ee5969114, role_id=3ce491f94839419ea9ba3b84324fcd8f)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:12.621914 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a91a7e-49c0-42b4-9139-2034a4f33c2c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:12.671453 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae13bd-7e3b-49a7-80fc-e760d122de85 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:12.671954 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae13bd-7e3b-49a7-80fc-e760d122de85 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:12.672055 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae13bd-7e3b-49a7-80fc-e760d122de85 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:12.673700 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 57/104] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:15:12.681852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d0c77-e3eb-44bb-9ee6-a4dcf8aef6e2 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:12.682163 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d0c77-e3eb-44bb-9ee6-a4dcf8aef6e2 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:12.682429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d0c77-e3eb-44bb-9ee6-a4dcf8aef6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:12.705359 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 48/105] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:15:12 2022] PUT /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/users/1ffb3d4925534295a000d01ee5969114/roles/3ce491f94839419ea9ba3b84324fcd8f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:12.710828 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-df2d0c77-e3eb-44bb-9ee6-a4dcf8aef6e2 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:12.712134 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-df2d0c77-e3eb-44bb-9ee6-a4dcf8aef6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:12.783543 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:12.794078 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 58/106] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:12.820701 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a91a7e-49c0-42b4-9139-2034a4f33c2c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:12.848628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:12.961085 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a91a7e-49c0-42b4-9139-2034a4f33c2c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:13.009459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52680141-89ae-4ba4-ad87-cd2289a6a545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:13.010285 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52680141-89ae-4ba4-ad87-cd2289a6a545 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:13.010576 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52680141-89ae-4ba4-ad87-cd2289a6a545 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:13.010961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52680141-89ae-4ba4-ad87-cd2289a6a545 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:13.027278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52680141-89ae-4ba4-ad87-cd2289a6a545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-52680141-89ae-4ba4-ad87-cd2289a6a545 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:13.036111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:13.037727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:13.039231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 49/107] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:15:13.043831 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d0c77-e3eb-44bb-9ee6-a4dcf8aef6e2 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:13.046789 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1eb6-c7c3-4f22-9f13-2e3fb621fbd5 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:13.047094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1eb6-c7c3-4f22-9f13-2e3fb621fbd5 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:13.047387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec1eb6-c7c3-4f22-9f13-2e3fb621fbd5 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:13.049092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 50/108] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:13.061337 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccdf4c-979c-4cad-838d-c8fa29ec37aa None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:13.061578 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccdf4c-979c-4cad-838d-c8fa29ec37aa None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:13.061866 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccdf4c-979c-4cad-838d-c8fa29ec37aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:13.094628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-bfccdf4c-979c-4cad-838d-c8fa29ec37aa None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:13.097481 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-bfccdf4c-979c-4cad-838d-c8fa29ec37aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:13.178319 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d0c77-e3eb-44bb-9ee6-a4dcf8aef6e2 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:13.222962 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543d45-e114-471b-91df-cf4def6af537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:13.223656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543d45-e114-471b-91df-cf4def6af537 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:13.223948 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543d45-e114-471b-91df-cf4def6af537 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:13.224232 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543d45-e114-471b-91df-cf4def6af537 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:13.225002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543d45-e114-471b-91df-cf4def6af537 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:13.225318 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543d45-e114-471b-91df-cf4def6af537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:13.226745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543d45-e114-471b-91df-cf4def6af537 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:13.235558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 59/109] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:13.242842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543d45-e114-471b-91df-cf4def6af537 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:13.284092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 51/110] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:13.321024 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccdf4c-979c-4cad-838d-c8fa29ec37aa None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:13.323448 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:13.335281 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:13.369541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543d45-e114-471b-91df-cf4def6af537 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:13.405613 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb971547-3f0e-48e1-943a-e1aa0d72438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:13.406514 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971547-3f0e-48e1-943a-e1aa0d72438c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:13.406838 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971547-3f0e-48e1-943a-e1aa0d72438c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:13.407343 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb971547-3f0e-48e1-943a-e1aa0d72438c None admin] PATH_INFO: `/v3/users/5744f36e03d24fac9c4176c9d5fdab3b` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:13.423713 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb971547-3f0e-48e1-943a-e1aa0d72438c None admin] RBAC: Authorizing `identity:get_user(user_id=5744f36e03d24fac9c4176c9d5fdab3b)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:13.425197 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb971547-3f0e-48e1-943a-e1aa0d72438c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:13.427032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 60/111] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:13 2022] GET /identity/v3/users/5744f36e03d24fac9c4176c9d5fdab3b => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:13.431928 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f01f-1c9d-4aed-ad50-677cae94e705 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:13.432227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f01f-1c9d-4aed-ad50-677cae94e705 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:13.432516 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f01f-1c9d-4aed-ad50-677cae94e705 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:13.434043 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 61/112] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:13.438685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5f01f-1c9d-4aed-ad50-677cae94e705 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:13.475865 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccdf4c-979c-4cad-838d-c8fa29ec37aa None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:13.561674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edadf5-89b0-44bd-b3ab-f871ed47e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:13.562679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edadf5-89b0-44bd-b3ab-f871ed47e3cc None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:13.563657 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edadf5-89b0-44bd-b3ab-f871ed47e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:13.563938 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edadf5-89b0-44bd-b3ab-f871ed47e3cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:13.566452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edadf5-89b0-44bd-b3ab-f871ed47e3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:13.569323 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edadf5-89b0-44bd-b3ab-f871ed47e3cc None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:13.573720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 52/113] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:15:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:13.574933 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20cf50-67cc-4869-a6c7-c018918279bc None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:13.575220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20cf50-67cc-4869-a6c7-c018918279bc None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:13.575500 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20cf50-67cc-4869-a6c7-c018918279bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:13.610407 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-5c20cf50-67cc-4869-a6c7-c018918279bc None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:13.611643 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-5c20cf50-67cc-4869-a6c7-c018918279bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:13.643023 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5f01f-1c9d-4aed-ad50-677cae94e705 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:13.673303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:13.712297 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f60c4-47d9-40cf-8318-a27c5251bb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:13.713018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f60c4-47d9-40cf-8318-a27c5251bb86 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:13.713310 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f60c4-47d9-40cf-8318-a27c5251bb86 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:13.713590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f60c4-47d9-40cf-8318-a27c5251bb86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:13.740149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 53/114] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:13.740995 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20cf50-67cc-4869-a6c7-c018918279bc None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:13.746944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:13.873926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f60c4-47d9-40cf-8318-a27c5251bb86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:13.875946 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f60c4-47d9-40cf-8318-a27c5251bb86 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:13.994848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 62/115] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:13.995774 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f60c4-47d9-40cf-8318-a27c5251bb86 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:14.011766 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:14.020627 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20cf50-67cc-4869-a6c7-c018918279bc None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:14.100715 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7d2db-94a1-4431-abe6-47d48699d489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:14.101389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7d2db-94a1-4431-abe6-47d48699d489 None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.101672 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7d2db-94a1-4431-abe6-47d48699d489 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.101948 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7d2db-94a1-4431-abe6-47d48699d489 None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.102676 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7d2db-94a1-4431-abe6-47d48699d489 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:14.106320 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7d2db-94a1-4431-abe6-47d48699d489 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:14.148200 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f60c4-47d9-40cf-8318-a27c5251bb86 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:14.184164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016e0c8-9299-4e55-b4f5-258643150374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:14.185545 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e0c8-9299-4e55-b4f5-258643150374 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.186205 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e0c8-9299-4e55-b4f5-258643150374 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.186632 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016e0c8-9299-4e55-b4f5-258643150374 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.197175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016e0c8-9299-4e55-b4f5-258643150374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:14.209856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 54/116] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 14:15:13 2022] POST /identity/v3/projects => generated 302 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:15:14.210735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7d2db-94a1-4431-abe6-47d48699d489 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-c016e0c8-9299-4e55-b4f5-258643150374 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:14.216992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:14.217994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:14.220280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:14.227900 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 63/117] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:15:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:14.234666 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016e0c8-9299-4e55-b4f5-258643150374 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:14.323171 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:14.334797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7d2db-94a1-4431-abe6-47d48699d489 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:14.358411 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:14.372655 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34453329-a5be-4e54-9d37-91eb0a6e1f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:14.373650 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453329-a5be-4e54-9d37-91eb0a6e1f26 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.374006 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453329-a5be-4e54-9d37-91eb0a6e1f26 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.374354 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453329-a5be-4e54-9d37-91eb0a6e1f26 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.375717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34453329-a5be-4e54-9d37-91eb0a6e1f26 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:14.377350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34453329-a5be-4e54-9d37-91eb0a6e1f26 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:14.379690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 55/118] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:14 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:14.381042 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555287-ca8d-4e46-b00f-3bde167b2192 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.381368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555287-ca8d-4e46-b00f-3bde167b2192 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.381717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa555287-ca8d-4e46-b00f-3bde167b2192 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.387104 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 56/119] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:14.387104 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa555287-ca8d-4e46-b00f-3bde167b2192 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:14.417695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016e0c8-9299-4e55-b4f5-258643150374 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:14.470873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c44663-cdae-4320-a29a-2fee7c5f00c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:14.471566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44663-cdae-4320-a29a-2fee7c5f00c7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.471857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44663-cdae-4320-a29a-2fee7c5f00c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.472198 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44663-cdae-4320-a29a-2fee7c5f00c7 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.473004 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c44663-cdae-4320-a29a-2fee7c5f00c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:14.473321 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c44663-cdae-4320-a29a-2fee7c5f00c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:14.474802 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c44663-cdae-4320-a29a-2fee7c5f00c7 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:14.487964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 64/120] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:14.489122 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16a71a-ac74-449f-99ad-4128411dc1e5 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.489423 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16a71a-ac74-449f-99ad-4128411dc1e5 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.489709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16a71a-ac74-449f-99ad-4128411dc1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.514162 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-2a16a71a-ac74-449f-99ad-4128411dc1e5 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:14.515472 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-2a16a71a-ac74-449f-99ad-4128411dc1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:14.542293 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa555287-ca8d-4e46-b00f-3bde167b2192 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:14.567686 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:14.587602 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57e76e-5995-4d50-9ea0-e8f7d38d1922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:14.589410 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57e76e-5995-4d50-9ea0-e8f7d38d1922 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.589737 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57e76e-5995-4d50-9ea0-e8f7d38d1922 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.590253 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57e76e-5995-4d50-9ea0-e8f7d38d1922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.591151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57e76e-5995-4d50-9ea0-e8f7d38d1922 None admin] RBAC: Adding query filter params (role.id=cfd002a6d7564425bfaa1379d4b2c562, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9, user.id=5744f36e03d24fac9c4176c9d5fdab3b) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:14.592012 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57e76e-5995-4d50-9ea0-e8f7d38d1922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:14.593975 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57e76e-5995-4d50-9ea0-e8f7d38d1922 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:14.599992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 57/121] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:14 2022] GET /identity/v3/role_assignments?user.id=5744f36e03d24fac9c4176c9d5fdab3b&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=cfd002a6d7564425bfaa1379d4b2c562 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:14.600797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 65/122] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:14.601830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16a71a-ac74-449f-99ad-4128411dc1e5 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:14.608099 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00ab9-0ad1-46e7-a5db-473a2824b08f None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.608615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00ab9-0ad1-46e7-a5db-473a2824b08f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.609079 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00ab9-0ad1-46e7-a5db-473a2824b08f None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.610558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 58/123] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:14.618453 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce56230-c7e6-4cb2-837f-d408e6f0610a None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.618892 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce56230-c7e6-4cb2-837f-d408e6f0610a None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.619093 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce56230-c7e6-4cb2-837f-d408e6f0610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.650183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-9ce56230-c7e6-4cb2-837f-d408e6f0610a None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:14.651445 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-9ce56230-c7e6-4cb2-837f-d408e6f0610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:14.683739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:14.729189 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16a71a-ac74-449f-99ad-4128411dc1e5 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:14.773797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba539d0-4be4-4069-8d55-49bd8e3acee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:14.774750 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba539d0-4be4-4069-8d55-49bd8e3acee5 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.775053 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba539d0-4be4-4069-8d55-49bd8e3acee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.775345 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba539d0-4be4-4069-8d55-49bd8e3acee5 None admin] PATH_INFO: `/v3/users/178ae9fcbcd542059cfd780cab7fed93` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.777234 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba539d0-4be4-4069-8d55-49bd8e3acee5 None admin] RBAC: Authorizing `identity:get_user(user_id=178ae9fcbcd542059cfd780cab7fed93)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:14.780067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba539d0-4be4-4069-8d55-49bd8e3acee5 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:14.782045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 66/124] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:14 2022] GET /identity/v3/users/178ae9fcbcd542059cfd780cab7fed93 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:14.783231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba539d0-4be4-4069-8d55-49bd8e3acee5 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:14.792542 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 59/125] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:14.793497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce56230-c7e6-4cb2-837f-d408e6f0610a None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:14.912859 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba539d0-4be4-4069-8d55-49bd8e3acee5 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:14.949414 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:14.957516 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e88fa5-0fb0-4992-858d-164c9a769480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:14.964546 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e88fa5-0fb0-4992-858d-164c9a769480 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:14.964546 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e88fa5-0fb0-4992-858d-164c9a769480 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:14.964546 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e88fa5-0fb0-4992-858d-164c9a769480 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:14.971413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e88fa5-0fb0-4992-858d-164c9a769480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-d7e88fa5-0fb0-4992-858d-164c9a769480 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:14.980886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:14.982425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:14.983541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:14.985813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 67/126] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:14.991845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e88fa5-0fb0-4992-858d-164c9a769480 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:15.021863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce56230-c7e6-4cb2-837f-d408e6f0610a None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:15.060228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:15.094558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082f218-a9ed-4d94-940b-e16b017ffc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:15.095961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082f218-a9ed-4d94-940b-e16b017ffc1e None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:15.096248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082f218-a9ed-4d94-940b-e16b017ffc1e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:15.096526 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082f218-a9ed-4d94-940b-e16b017ffc1e None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:15.097994 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082f218-a9ed-4d94-940b-e16b017ffc1e None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:15.099503 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082f218-a9ed-4d94-940b-e16b017ffc1e None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:15.101428 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 60/127] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:14 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:15.102021 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082f218-a9ed-4d94-940b-e16b017ffc1e None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:15.148882 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e88fa5-0fb0-4992-858d-164c9a769480 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:15.185661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8152b9-0806-43c0-99cc-8104849dd6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:15.187095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8152b9-0806-43c0-99cc-8104849dd6cc None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:15.187601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8152b9-0806-43c0-99cc-8104849dd6cc None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:15.188088 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8152b9-0806-43c0-99cc-8104849dd6cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:15.199456 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8152b9-0806-43c0-99cc-8104849dd6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-fd8152b9-0806-43c0-99cc-8104849dd6cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:15.208359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:15.209204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:15.209968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:15.212706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 68/128] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:15.213837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8152b9-0806-43c0-99cc-8104849dd6cc None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:15.272221 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:15.314501 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082f218-a9ed-4d94-940b-e16b017ffc1e None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:15.322871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8152b9-0806-43c0-99cc-8104849dd6cc None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:15.365111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d1ec0-220c-4723-9ba8-c42ef7906848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:15.366370 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d1ec0-220c-4723-9ba8-c42ef7906848 None admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:15.368051 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d1ec0-220c-4723-9ba8-c42ef7906848 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:15.368530 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d1ec0-220c-4723-9ba8-c42ef7906848 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/users/178ae9fcbcd542059cfd780cab7fed93/roles/61482861f00e45048fc1d45570c4c99b` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:15.372361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d1ec0-220c-4723-9ba8-c42ef7906848 None admin] RBAC: Authorizing `identity:create_grant(project_id=0530adf9f8454784a3bdf6998c1fc7b9, user_id=178ae9fcbcd542059cfd780cab7fed93, role_id=61482861f00e45048fc1d45570c4c99b)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:15.374787 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d1ec0-220c-4723-9ba8-c42ef7906848 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:15.391847 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f1939-eda3-475d-afec-35bf99e10352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:15.398183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f1939-eda3-475d-afec-35bf99e10352 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:15.398183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f1939-eda3-475d-afec-35bf99e10352 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:15.398183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f1939-eda3-475d-afec-35bf99e10352 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:15.398183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f1939-eda3-475d-afec-35bf99e10352 None admin] RBAC: Adding query filter params (name=member) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:15.398183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f1939-eda3-475d-afec-35bf99e10352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:15.398183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f1939-eda3-475d-afec-35bf99e10352 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:15.405804 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 61/129] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:15.406945 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f1939-eda3-475d-afec-35bf99e10352 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:15.461726 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:15.511755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 69/130] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:15:15 2022] PUT /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/users/178ae9fcbcd542059cfd780cab7fed93/roles/61482861f00e45048fc1d45570c4c99b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:15.512900 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d1ec0-220c-4723-9ba8-c42ef7906848 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:15.537471 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f1939-eda3-475d-afec-35bf99e10352 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:15.612947 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750e4f5-aa9b-4cd9-969c-6f4f11ec84c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:15.614395 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e4f5-aa9b-4cd9-969c-6f4f11ec84c2 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:15.614876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e4f5-aa9b-4cd9-969c-6f4f11ec84c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:15.615350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e4f5-aa9b-4cd9-969c-6f4f11ec84c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:15.616283 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e4f5-aa9b-4cd9-969c-6f4f11ec84c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:15.616765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e4f5-aa9b-4cd9-969c-6f4f11ec84c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:15.618331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e4f5-aa9b-4cd9-969c-6f4f11ec84c2 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:15.637199 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 62/131] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:15.643930 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750e4f5-aa9b-4cd9-969c-6f4f11ec84c2 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:15.718447 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d1ec0-220c-4723-9ba8-c42ef7906848 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:15.740470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:15.766435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bde22-7556-4246-9a32-74a0de7495c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:15.767833 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bde22-7556-4246-9a32-74a0de7495c1 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:15.768296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bde22-7556-4246-9a32-74a0de7495c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:15.768805 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bde22-7556-4246-9a32-74a0de7495c1 None admin] PATH_INFO: `/v3/users/1ffb3d4925534295a000d01ee5969114` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:15.770315 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bde22-7556-4246-9a32-74a0de7495c1 None admin] RBAC: Authorizing `identity:get_user(user_id=1ffb3d4925534295a000d01ee5969114)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:15.772043 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bde22-7556-4246-9a32-74a0de7495c1 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:15.773961 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 70/132] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:15 2022] GET /identity/v3/users/1ffb3d4925534295a000d01ee5969114 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:15.775606 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b100e-f8c0-4609-9ec4-0df8f6ef321d None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:15.777615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b100e-f8c0-4609-9ec4-0df8f6ef321d None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:15.778044 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b100e-f8c0-4609-9ec4-0df8f6ef321d None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:15.779661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 71/133] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:15.780539 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b100e-f8c0-4609-9ec4-0df8f6ef321d None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:15.848766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750e4f5-aa9b-4cd9-969c-6f4f11ec84c2 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:15.864711 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:15.897883 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324af418-adc8-4e2c-9495-1184e13e8e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:15.899282 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af418-adc8-4e2c-9495-1184e13e8e21 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:15.900088 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af418-adc8-4e2c-9495-1184e13e8e21 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:15.900789 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af418-adc8-4e2c-9495-1184e13e8e21 None admin] PATH_INFO: `/v3/users/1ffb3d4925534295a000d01ee5969114` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:15.903933 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324af418-adc8-4e2c-9495-1184e13e8e21 None admin] RBAC: Authorizing `identity:get_user(user_id=1ffb3d4925534295a000d01ee5969114)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:15.905938 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324af418-adc8-4e2c-9495-1184e13e8e21 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:15.907731 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b100e-f8c0-4609-9ec4-0df8f6ef321d None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:15.907934 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 63/134] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:15 2022] GET /identity/v3/users/1ffb3d4925534295a000d01ee5969114 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:15.912300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca8b7-85b7-4fc2-9543-a602f340c2ee None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:15.912300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca8b7-85b7-4fc2-9543-a602f340c2ee None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:15.912300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca8b7-85b7-4fc2-9543-a602f340c2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:15.942002 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-ca7ca8b7-85b7-4fc2-9543-a602f340c2ee None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:15.946662 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-ca7ca8b7-85b7-4fc2-9543-a602f340c2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:15.979422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9fc1f-84db-48ae-b4c4-cdabf4414651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:15.980215 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9fc1f-84db-48ae-b4c4-cdabf4414651 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:15.980503 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9fc1f-84db-48ae-b4c4-cdabf4414651 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:15.980787 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9fc1f-84db-48ae-b4c4-cdabf4414651 None admin] PATH_INFO: `/v3/projects/cd29d2e9470f41e3b1d390f9282a22b3` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:15.983863 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9fc1f-84db-48ae-b4c4-cdabf4414651 None admin] RBAC: Authorizing `identity:get_project(project_id=cd29d2e9470f41e3b1d390f9282a22b3)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:15.985380 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9fc1f-84db-48ae-b4c4-cdabf4414651 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:15.991437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 72/135] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:15 2022] GET /identity/v3/projects/cd29d2e9470f41e3b1d390f9282a22b3 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:15.992365 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9fc1f-84db-48ae-b4c4-cdabf4414651 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:16.047909 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 64/136] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:16.048764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca8b7-85b7-4fc2-9543-a602f340c2ee None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:16.121558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:16.154316 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca8b7-85b7-4fc2-9543-a602f340c2ee None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:16.164598 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:16.195462 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55b980-470b-4e90-a98d-c7cdf5b45905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:16.196365 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55b980-470b-4e90-a98d-c7cdf5b45905 None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:16.196659 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55b980-470b-4e90-a98d-c7cdf5b45905 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:16.196946 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55b980-470b-4e90-a98d-c7cdf5b45905 None admin] PATH_INFO: `/v3/projects/cd29d2e9470f41e3b1d390f9282a22b3/users/1ffb3d4925534295a000d01ee5969114/roles/3ce491f94839419ea9ba3b84324fcd8f` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:16.200101 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55b980-470b-4e90-a98d-c7cdf5b45905 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd29d2e9470f41e3b1d390f9282a22b3, user_id=1ffb3d4925534295a000d01ee5969114, role_id=3ce491f94839419ea9ba3b84324fcd8f)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:16.201699 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55b980-470b-4e90-a98d-c7cdf5b45905 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:16.210804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9fc1f-84db-48ae-b4c4-cdabf4414651 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:16.253818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44855ae1-484e-474b-8bc6-6b5cc8b9a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:16.254945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44855ae1-484e-474b-8bc6-6b5cc8b9a63f None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:16.255232 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44855ae1-484e-474b-8bc6-6b5cc8b9a63f None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:16.255513 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44855ae1-484e-474b-8bc6-6b5cc8b9a63f None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:16.256730 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44855ae1-484e-474b-8bc6-6b5cc8b9a63f None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:16.258287 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44855ae1-484e-474b-8bc6-6b5cc8b9a63f None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:16.260087 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 73/137] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:15 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:16.260862 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44855ae1-484e-474b-8bc6-6b5cc8b9a63f None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:16.286848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 65/138] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:15:16 2022] PUT /identity/v3/projects/cd29d2e9470f41e3b1d390f9282a22b3/users/1ffb3d4925534295a000d01ee5969114/roles/3ce491f94839419ea9ba3b84324fcd8f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:16.287726 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55b980-470b-4e90-a98d-c7cdf5b45905 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:16.460012 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44855ae1-484e-474b-8bc6-6b5cc8b9a63f None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:16.502158 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:16.516370 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55b980-470b-4e90-a98d-c7cdf5b45905 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:16.550140 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0aabc9-4d04-4394-870c-cc74513d29f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:16.550991 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aabc9-4d04-4394-870c-cc74513d29f8 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:16.551286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aabc9-4d04-4394-870c-cc74513d29f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:16.551571 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aabc9-4d04-4394-870c-cc74513d29f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:16.576776 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0aabc9-4d04-4394-870c-cc74513d29f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-8e0aabc9-4d04-4394-870c-cc74513d29f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:16.585752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:16.586600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:16.587435 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:16.592418 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 74/139] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:16.599373 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7d361-a27b-4afc-9a80-84d0a2e917ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:16.599820 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0aabc9-4d04-4394-870c-cc74513d29f8 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:16.600856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d361-a27b-4afc-9a80-84d0a2e917ea None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:16.601336 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d361-a27b-4afc-9a80-84d0a2e917ea None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:16.601826 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7d361-a27b-4afc-9a80-84d0a2e917ea None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/users/1ffb3d4925534295a000d01ee5969114/roles/5782703fc53f48f28fb7015ae693cd60` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:16.604578 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7d361-a27b-4afc-9a80-84d0a2e917ea None admin] RBAC: Authorizing `identity:create_grant(project_id=0530adf9f8454784a3bdf6998c1fc7b9, user_id=1ffb3d4925534295a000d01ee5969114, role_id=5782703fc53f48f28fb7015ae693cd60)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:16.606311 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7d361-a27b-4afc-9a80-84d0a2e917ea None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:16.688899 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 66/140] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:15:16 2022] PUT /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/users/1ffb3d4925534295a000d01ee5969114/roles/5782703fc53f48f28fb7015ae693cd60 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:16.743896 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0aabc9-4d04-4394-870c-cc74513d29f8 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:16.790037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014503bb-022c-43c5-82eb-cf515d74aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:16.790684 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014503bb-022c-43c5-82eb-cf515d74aa23 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:16.790955 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014503bb-022c-43c5-82eb-cf515d74aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:16.791250 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014503bb-022c-43c5-82eb-cf515d74aa23 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:16.792084 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014503bb-022c-43c5-82eb-cf515d74aa23 None admin] RBAC: Adding query filter params (name=member) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:16.792401 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014503bb-022c-43c5-82eb-cf515d74aa23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:16.793804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014503bb-022c-43c5-82eb-cf515d74aa23 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:16.804162 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 75/141] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:16.809878 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7d361-a27b-4afc-9a80-84d0a2e917ea None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:16.860518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:16.954231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7d361-a27b-4afc-9a80-84d0a2e917ea None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:16.993520 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f00a2-98a9-4fe8-8c26-6daf87e1ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:16.994669 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f00a2-98a9-4fe8-8c26-6daf87e1ac07 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:16.994960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f00a2-98a9-4fe8-8c26-6daf87e1ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:16.995241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f00a2-98a9-4fe8-8c26-6daf87e1ac07 None admin] PATH_INFO: `/v3/users/1ffb3d4925534295a000d01ee5969114` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:16.996508 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f00a2-98a9-4fe8-8c26-6daf87e1ac07 None admin] RBAC: Authorizing `identity:get_user(user_id=1ffb3d4925534295a000d01ee5969114)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:16.998039 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f00a2-98a9-4fe8-8c26-6daf87e1ac07 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:16.999918 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 67/142] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:16 2022] GET /identity/v3/users/1ffb3d4925534295a000d01ee5969114 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:17.006633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014503bb-022c-43c5-82eb-cf515d74aa23 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:17.054924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:17.127723 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014503bb-022c-43c5-82eb-cf515d74aa23 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:17.173086 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d86242-fba7-42b2-a640-25b510f8e9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:17.173745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d86242-fba7-42b2-a640-25b510f8e9c1 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:17.174029 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d86242-fba7-42b2-a640-25b510f8e9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:17.174309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d86242-fba7-42b2-a640-25b510f8e9c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:17.256948 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d86242-fba7-42b2-a640-25b510f8e9c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:17.258522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d86242-fba7-42b2-a640-25b510f8e9c1 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:17.328522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:17.420761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 76/143] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:17.426788 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f00a2-98a9-4fe8-8c26-6daf87e1ac07 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:17.558137 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:17.568215 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f00a2-98a9-4fe8-8c26-6daf87e1ac07 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:17.620461 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28f35e-1bc0-42cb-b391-9ff5a00eeca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:17.621628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28f35e-1bc0-42cb-b391-9ff5a00eeca5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:17.622084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28f35e-1bc0-42cb-b391-9ff5a00eeca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:17.623101 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28f35e-1bc0-42cb-b391-9ff5a00eeca5 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:17.627375 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28f35e-1bc0-42cb-b391-9ff5a00eeca5 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:17.629677 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28f35e-1bc0-42cb-b391-9ff5a00eeca5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:17.630735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b5213-fb7e-4894-a46f-8f34faa90ebf None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:17.631102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b5213-fb7e-4894-a46f-8f34faa90ebf None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:17.631459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b5213-fb7e-4894-a46f-8f34faa90ebf None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:17.632252 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 68/144] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:17 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:17.632987 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 77/145] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:17.638705 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072de006-a18e-48ab-9434-243a354bb644 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:17.639202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072de006-a18e-48ab-9434-243a354bb644 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:17.639654 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072de006-a18e-48ab-9434-243a354bb644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:17.642697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b5213-fb7e-4894-a46f-8f34faa90ebf None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:17.668343 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-072de006-a18e-48ab-9434-243a354bb644 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:17.670379 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-072de006-a18e-48ab-9434-243a354bb644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:17.806721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b5213-fb7e-4894-a46f-8f34faa90ebf None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:17.809263 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 69/146] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:17.810856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994a3aa-9e06-48b3-a3a0-16b87f9954ed None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:17.811154 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994a3aa-9e06-48b3-a3a0-16b87f9954ed None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:17.811437 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994a3aa-9e06-48b3-a3a0-16b87f9954ed None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:17.812880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 70/147] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:17.823985 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641055c1-978a-4ff9-bb40-976a247ae714 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:17.824280 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641055c1-978a-4ff9-bb40-976a247ae714 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:17.824568 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641055c1-978a-4ff9-bb40-976a247ae714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:17.847794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b118-40b9-49d9-8818-e097fd0de6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:17.848456 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b118-40b9-49d9-8818-e097fd0de6bf None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:17.848743 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b118-40b9-49d9-8818-e097fd0de6bf None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:17.849022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b118-40b9-49d9-8818-e097fd0de6bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:17.849863 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b118-40b9-49d9-8818-e097fd0de6bf None admin] RBAC: Adding query filter params (role.id=3ce491f94839419ea9ba3b84324fcd8f, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9, user.id=1ffb3d4925534295a000d01ee5969114) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:17.850181 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b118-40b9-49d9-8818-e097fd0de6bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:17.851685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b118-40b9-49d9-8818-e097fd0de6bf None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:17.858765 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 78/148] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:17 2022] GET /identity/v3/role_assignments?user.id=1ffb3d4925534295a000d01ee5969114&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:17.867849 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-641055c1-978a-4ff9-bb40-976a247ae714 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:17.869123 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-641055c1-978a-4ff9-bb40-976a247ae714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:17.885333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b118-40b9-49d9-8818-e097fd0de6bf None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:17.905328 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:18.037634 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 71/149] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:18.044400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b118-40b9-49d9-8818-e097fd0de6bf None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:18.077205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641055c1-978a-4ff9-bb40-976a247ae714 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:18.093541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05c317-1b1f-4821-a5e5-040f5842fc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:18.094475 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05c317-1b1f-4821-a5e5-040f5842fc9b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:18.094797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05c317-1b1f-4821-a5e5-040f5842fc9b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:18.095075 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05c317-1b1f-4821-a5e5-040f5842fc9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:18.096298 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05c317-1b1f-4821-a5e5-040f5842fc9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:18.097913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05c317-1b1f-4821-a5e5-040f5842fc9b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:18.099758 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 79/150] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:15:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:18.105473 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05c317-1b1f-4821-a5e5-040f5842fc9b None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:18.141911 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:18.199025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:18.222968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05c317-1b1f-4821-a5e5-040f5842fc9b None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:18.265880 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efefaa8-b8f9-4550-aed6-d0c3ee89e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:18.267395 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efefaa8-b8f9-4550-aed6-d0c3ee89e594 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:18.267693 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efefaa8-b8f9-4550-aed6-d0c3ee89e594 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:18.267975 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efefaa8-b8f9-4550-aed6-d0c3ee89e594 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:18.269242 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efefaa8-b8f9-4550-aed6-d0c3ee89e594 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:18.271170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efefaa8-b8f9-4550-aed6-d0c3ee89e594 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:18.312488 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641055c1-978a-4ff9-bb40-976a247ae714 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:18.348996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29aa908-9e35-4959-b4da-b0a341a46aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:18.349805 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29aa908-9e35-4959-b4da-b0a341a46aad None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:18.350089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29aa908-9e35-4959-b4da-b0a341a46aad None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:18.350368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29aa908-9e35-4959-b4da-b0a341a46aad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:18.362426 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29aa908-9e35-4959-b4da-b0a341a46aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-e29aa908-9e35-4959-b4da-b0a341a46aad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:18.370112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:18.370958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:18.372188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 72/151] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:15:18.377639 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29aa908-9e35-4959-b4da-b0a341a46aad None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:18.396221 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 80/152] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:15:18 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:15:18.480296 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:18.498258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29aa908-9e35-4959-b4da-b0a341a46aad None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:18.542121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d633-f22a-4a95-8a94-5b377a981a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:18.542848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d633-f22a-4a95-8a94-5b377a981a96 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:18.543138 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d633-f22a-4a95-8a94-5b377a981a96 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:18.543422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d633-f22a-4a95-8a94-5b377a981a96 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:18.544205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352d633-f22a-4a95-8a94-5b377a981a96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:18.545239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352d633-f22a-4a95-8a94-5b377a981a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:18.546721 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352d633-f22a-4a95-8a94-5b377a981a96 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:18.557052 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 73/153] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:18.563883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efefaa8-b8f9-4550-aed6-d0c3ee89e594 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:18.725654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efefaa8-b8f9-4550-aed6-d0c3ee89e594 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:18.759594 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:18.770123 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ed81-bf1c-45b8-9f3b-06f1b22a4e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:18.774455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ed81-bf1c-45b8-9f3b-06f1b22a4e2c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:18.774455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ed81-bf1c-45b8-9f3b-06f1b22a4e2c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:18.774455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602ed81-bf1c-45b8-9f3b-06f1b22a4e2c None admin] PATH_INFO: `/v3/users/5744f36e03d24fac9c4176c9d5fdab3b` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:18.774455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ed81-bf1c-45b8-9f3b-06f1b22a4e2c None admin] RBAC: Authorizing `identity:get_user(user_id=5744f36e03d24fac9c4176c9d5fdab3b)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:18.775149 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602ed81-bf1c-45b8-9f3b-06f1b22a4e2c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:18.776537 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 81/154] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:18 2022] GET /identity/v3/users/5744f36e03d24fac9c4176c9d5fdab3b => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:18.782596 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d633-f22a-4a95-8a94-5b377a981a96 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:18.938683 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d633-f22a-4a95-8a94-5b377a981a96 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:18.981084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a7bd6-f299-4a98-a6a7-8fa233c09b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:18.982864 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a7bd6-f299-4a98-a6a7-8fa233c09b84 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:18.983367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a7bd6-f299-4a98-a6a7-8fa233c09b84 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:18.983833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a7bd6-f299-4a98-a6a7-8fa233c09b84 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:18.985308 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a7bd6-f299-4a98-a6a7-8fa233c09b84 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:18.987084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a7bd6-f299-4a98-a6a7-8fa233c09b84 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:18.989491 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 74/155] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:18 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:18.995380 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ed81-bf1c-45b8-9f3b-06f1b22a4e2c None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:19.123943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602ed81-bf1c-45b8-9f3b-06f1b22a4e2c None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:19.166093 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc6ab2-2718-4217-99b4-3bc82b6c28e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:19.167099 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc6ab2-2718-4217-99b4-3bc82b6c28e8 None admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:19.167385 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc6ab2-2718-4217-99b4-3bc82b6c28e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:19.167671 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc6ab2-2718-4217-99b4-3bc82b6c28e8 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/users/5744f36e03d24fac9c4176c9d5fdab3b/roles/cfd002a6d7564425bfaa1379d4b2c562` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:19.169387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cbd31-7f2a-4e6b-b28a-524bc798fa33 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:19.170377 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cbd31-7f2a-4e6b-b28a-524bc798fa33 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:19.170544 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc6ab2-2718-4217-99b4-3bc82b6c28e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0530adf9f8454784a3bdf6998c1fc7b9, user_id=5744f36e03d24fac9c4176c9d5fdab3b, role_id=cfd002a6d7564425bfaa1379d4b2c562)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:19.171353 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cbd31-7f2a-4e6b-b28a-524bc798fa33 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:19.172356 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc6ab2-2718-4217-99b4-3bc82b6c28e8 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:19.173134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 75/156] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:19.179938 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dfefe-43e4-4e86-a407-0330df9f5305 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:19.180301 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dfefe-43e4-4e86-a407-0330df9f5305 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:19.180651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dfefe-43e4-4e86-a407-0330df9f5305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:19.202931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-6f4dfefe-43e4-4e86-a407-0330df9f5305 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:19.204508 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-6f4dfefe-43e4-4e86-a407-0330df9f5305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:19.215558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:19.257055 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 82/157] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:15:18 2022] PUT /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/users/5744f36e03d24fac9c4176c9d5fdab3b/roles/cfd002a6d7564425bfaa1379d4b2c562 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:19.288506 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 76/158] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:19.316822 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc6ab2-2718-4217-99b4-3bc82b6c28e8 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:19.384996 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:19.445727 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc6ab2-2718-4217-99b4-3bc82b6c28e8 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:19.498130 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faac137-9ced-4b0a-8f8d-9c359c40d643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:19.498130 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac137-9ced-4b0a-8f8d-9c359c40d643 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:19.498518 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac137-9ced-4b0a-8f8d-9c359c40d643 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:19.498906 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac137-9ced-4b0a-8f8d-9c359c40d643 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:19.515089 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac137-9ced-4b0a-8f8d-9c359c40d643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-4faac137-9ced-4b0a-8f8d-9c359c40d643 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:19.522892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:19.523804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:19.524643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 83/159] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:19.531335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dfefe-43e4-4e86-a407-0330df9f5305 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:19.667918 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dfefe-43e4-4e86-a407-0330df9f5305 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:19.710116 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82cd8e-1480-42e7-93fc-7d8b5d06edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:19.710849 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82cd8e-1480-42e7-93fc-7d8b5d06edd5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:19.711109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82cd8e-1480-42e7-93fc-7d8b5d06edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:19.711401 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82cd8e-1480-42e7-93fc-7d8b5d06edd5 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:19.712164 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82cd8e-1480-42e7-93fc-7d8b5d06edd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:19.712471 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82cd8e-1480-42e7-93fc-7d8b5d06edd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:19.713872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82cd8e-1480-42e7-93fc-7d8b5d06edd5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:19.727105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 77/160] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:19.732712 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faac137-9ced-4b0a-8f8d-9c359c40d643 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:19.848066 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faac137-9ced-4b0a-8f8d-9c359c40d643 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:19.863271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:19.892476 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c9451-8c98-44af-8111-b6247f1fef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:19.893424 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c9451-8c98-44af-8111-b6247f1fef37 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:19.893718 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c9451-8c98-44af-8111-b6247f1fef37 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:19.893998 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c9451-8c98-44af-8111-b6247f1fef37 None admin] PATH_INFO: `/v3/users/178ae9fcbcd542059cfd780cab7fed93` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:19.895251 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c9451-8c98-44af-8111-b6247f1fef37 None admin] RBAC: Authorizing `identity:get_user(user_id=178ae9fcbcd542059cfd780cab7fed93)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:19.899090 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c9451-8c98-44af-8111-b6247f1fef37 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:19.902748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 84/161] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:19 2022] GET /identity/v3/users/178ae9fcbcd542059cfd780cab7fed93 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:19.904908 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82cd8e-1480-42e7-93fc-7d8b5d06edd5 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:19.914594 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:19.953771 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b31a-9fa6-4015-a8aa-5c997cc89d26 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:19.954079 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b31a-9fa6-4015-a8aa-5c997cc89d26 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:19.954343 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b31a-9fa6-4015-a8aa-5c997cc89d26 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:19.956039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 85/162] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:19.961546 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db09b94-b9ac-4edc-8dc8-abf5e8450c47 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:19.961833 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db09b94-b9ac-4edc-8dc8-abf5e8450c47 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:19.962112 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db09b94-b9ac-4edc-8dc8-abf5e8450c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:19.993238 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-7db09b94-b9ac-4edc-8dc8-abf5e8450c47 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:19.994459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-7db09b94-b9ac-4edc-8dc8-abf5e8450c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:20.085004 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82cd8e-1480-42e7-93fc-7d8b5d06edd5 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:20.139958 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 86/163] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:20.143128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23e7dd-2363-44c1-9672-0e341ba2be0c None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:20.143421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23e7dd-2363-44c1-9672-0e341ba2be0c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:20.143705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23e7dd-2363-44c1-9672-0e341ba2be0c None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:20.145123 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 87/164] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:20.150987 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090e853-d1be-42dc-b60b-c23f47e8e754 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:20.151278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090e853-d1be-42dc-b60b-c23f47e8e754 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:20.151558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090e853-d1be-42dc-b60b-c23f47e8e754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:20.156197 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931497-c18e-4772-b53a-048385b6c11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:20.156861 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931497-c18e-4772-b53a-048385b6c11d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:20.157144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931497-c18e-4772-b53a-048385b6c11d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:20.157422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931497-c18e-4772-b53a-048385b6c11d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:20.186803 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-b090e853-d1be-42dc-b60b-c23f47e8e754 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:20.188014 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-b090e853-d1be-42dc-b60b-c23f47e8e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:20.280561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931497-c18e-4772-b53a-048385b6c11d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:20.282044 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931497-c18e-4772-b53a-048385b6c11d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:20.290084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:20.336618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 88/165] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:20.338720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090e853-d1be-42dc-b60b-c23f47e8e754 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:20.430553 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 78/166] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:20.431482 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931497-c18e-4772-b53a-048385b6c11d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:20.468376 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:20.545308 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931497-c18e-4772-b53a-048385b6c11d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:20.567023 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:20.582063 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bf980-ee38-4f17-9c52-e914d854c12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:20.588634 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bf980-ee38-4f17-9c52-e914d854c12b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:20.588634 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bf980-ee38-4f17-9c52-e914d854c12b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:20.588634 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bf980-ee38-4f17-9c52-e914d854c12b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:20.620421 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bf980-ee38-4f17-9c52-e914d854c12b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-a19bf980-ee38-4f17-9c52-e914d854c12b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:20.635706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:20.636616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:20.637572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 79/167] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:20.645660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bf980-ee38-4f17-9c52-e914d854c12b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:20.697413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090e853-d1be-42dc-b60b-c23f47e8e754 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:20.751515 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed34f37-4b87-4869-a803-abe24a48c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:20.752847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed34f37-4b87-4869-a803-abe24a48c450 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:20.753365 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed34f37-4b87-4869-a803-abe24a48c450 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:20.753841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed34f37-4b87-4869-a803-abe24a48c450 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:20.780147 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed34f37-4b87-4869-a803-abe24a48c450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-7ed34f37-4b87-4869-a803-abe24a48c450 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:20.789657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:20.790522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:20.791335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:20.798040 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 89/168] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:20.803994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed34f37-4b87-4869-a803-abe24a48c450 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:20.954231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bf980-ee38-4f17-9c52-e914d854c12b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:21.075389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea726b4-9047-4893-bd5c-9a65a4802b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:21.078667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea726b4-9047-4893-bd5c-9a65a4802b98 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:21.078667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea726b4-9047-4893-bd5c-9a65a4802b98 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:21.078667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea726b4-9047-4893-bd5c-9a65a4802b98 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:21.079380 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea726b4-9047-4893-bd5c-9a65a4802b98 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:21.080863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea726b4-9047-4893-bd5c-9a65a4802b98 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:21.094191 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 80/169] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:20 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:21.094191 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea726b4-9047-4893-bd5c-9a65a4802b98 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:21.157343 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed34f37-4b87-4869-a803-abe24a48c450 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:21.158700 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:21.163251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:21.264774 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99728bfb-bfc3-4250-a2b4-712bef94a432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:21.265380 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99728bfb-bfc3-4250-a2b4-712bef94a432 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:21.265670 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99728bfb-bfc3-4250-a2b4-712bef94a432 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:21.265949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99728bfb-bfc3-4250-a2b4-712bef94a432 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:21.271089 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99728bfb-bfc3-4250-a2b4-712bef94a432 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:21.271672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99728bfb-bfc3-4250-a2b4-712bef94a432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:21.273286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99728bfb-bfc3-4250-a2b4-712bef94a432 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:21.286080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea726b4-9047-4893-bd5c-9a65a4802b98 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:21.287843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 90/170] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:21.288973 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99728bfb-bfc3-4250-a2b4-712bef94a432 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:21.347442 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31079c3-1993-4d14-9952-6b965ecd95cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:21.348125 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31079c3-1993-4d14-9952-6b965ecd95cb None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:21.348415 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31079c3-1993-4d14-9952-6b965ecd95cb None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:21.348694 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31079c3-1993-4d14-9952-6b965ecd95cb None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:21.349445 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31079c3-1993-4d14-9952-6b965ecd95cb None admin] RBAC: Adding query filter params (name=member) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:21.349921 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31079c3-1993-4d14-9952-6b965ecd95cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:21.351475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31079c3-1993-4d14-9952-6b965ecd95cb None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:21.367758 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 81/171] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:21.368439 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31079c3-1993-4d14-9952-6b965ecd95cb None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:21.530698 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99728bfb-bfc3-4250-a2b4-712bef94a432 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:21.558035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:21.571280 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31079c3-1993-4d14-9952-6b965ecd95cb None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:21.603942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5760a06-5de2-43f5-9d45-50437b6394fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:21.604612 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5760a06-5de2-43f5-9d45-50437b6394fa None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:21.604892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5760a06-5de2-43f5-9d45-50437b6394fa None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:21.605167 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5760a06-5de2-43f5-9d45-50437b6394fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:21.606009 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5760a06-5de2-43f5-9d45-50437b6394fa None admin] RBAC: Adding query filter params (role.id=61482861f00e45048fc1d45570c4c99b, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9, user.id=178ae9fcbcd542059cfd780cab7fed93) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:21.606321 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5760a06-5de2-43f5-9d45-50437b6394fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:21.608099 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5760a06-5de2-43f5-9d45-50437b6394fa None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:21.625382 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 91/172] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:21 2022] GET /identity/v3/role_assignments?user.id=178ae9fcbcd542059cfd780cab7fed93&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=61482861f00e45048fc1d45570c4c99b => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:21.626241 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5760a06-5de2-43f5-9d45-50437b6394fa None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:21.640679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f5f7-4cc2-4045-be31-fa53bf6b2c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:21.642326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f5f7-4cc2-4045-be31-fa53bf6b2c95 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:21.642610 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f5f7-4cc2-4045-be31-fa53bf6b2c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:21.642989 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f5f7-4cc2-4045-be31-fa53bf6b2c95 None admin] PATH_INFO: `/v3/users/1ffb3d4925534295a000d01ee5969114` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:21.644220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077f5f7-4cc2-4045-be31-fa53bf6b2c95 None admin] RBAC: Authorizing `identity:get_user(user_id=1ffb3d4925534295a000d01ee5969114)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:21.645683 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077f5f7-4cc2-4045-be31-fa53bf6b2c95 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:21.647349 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 82/173] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:21 2022] GET /identity/v3/users/1ffb3d4925534295a000d01ee5969114 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:21.653494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f5f7-4cc2-4045-be31-fa53bf6b2c95 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:21.712138 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:21.881777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f5f7-4cc2-4045-be31-fa53bf6b2c95 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:21.899548 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5760a06-5de2-43f5-9d45-50437b6394fa None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:21.976272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0db833-def6-42fc-b527-0ceae6b1156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:21.976957 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0db833-def6-42fc-b527-0ceae6b1156a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:21.977243 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0db833-def6-42fc-b527-0ceae6b1156a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:21.977522 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0db833-def6-42fc-b527-0ceae6b1156a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:21.990620 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9f8a9-06a6-46a4-a678-e379bdf6632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:21.991541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9f8a9-06a6-46a4-a678-e379bdf6632a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:21.991827 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9f8a9-06a6-46a4-a678-e379bdf6632a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:21.992102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9f8a9-06a6-46a4-a678-e379bdf6632a None admin] PATH_INFO: `/v3/users/1ffb3d4925534295a000d01ee5969114` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:21.993669 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9f8a9-06a6-46a4-a678-e379bdf6632a None admin] RBAC: Authorizing `identity:get_user(user_id=1ffb3d4925534295a000d01ee5969114)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:21.997127 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9f8a9-06a6-46a4-a678-e379bdf6632a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:21.999109 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 92/174] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:21 2022] GET /identity/v3/users/1ffb3d4925534295a000d01ee5969114 => generated 275 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:22.004630 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9f8a9-06a6-46a4-a678-e379bdf6632a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:22.051925 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:22.081452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0db833-def6-42fc-b527-0ceae6b1156a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:22.082992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0db833-def6-42fc-b527-0ceae6b1156a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:22.208893 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:22.219914 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9f8a9-06a6-46a4-a678-e379bdf6632a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:22.268322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4027470-491f-43d7-87fc-be8774e9e00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:22.269059 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4027470-491f-43d7-87fc-be8774e9e00a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:22.269344 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4027470-491f-43d7-87fc-be8774e9e00a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:22.269666 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4027470-491f-43d7-87fc-be8774e9e00a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:22.284258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 83/175] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 14:15:22.290083 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0db833-def6-42fc-b527-0ceae6b1156a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:22.375234 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4027470-491f-43d7-87fc-be8774e9e00a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:22.375887 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:22.377024 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4027470-491f-43d7-87fc-be8774e9e00a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:22.420493 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0db833-def6-42fc-b527-0ceae6b1156a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:22.462143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f8d2b-1558-46b2-b05b-b7df71bf7e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:22.463524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f8d2b-1558-46b2-b05b-b7df71bf7e1d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:22.464008 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f8d2b-1558-46b2-b05b-b7df71bf7e1d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:22.464481 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f8d2b-1558-46b2-b05b-b7df71bf7e1d None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:22.467941 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f8d2b-1558-46b2-b05b-b7df71bf7e1d None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:22.472955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f8d2b-1558-46b2-b05b-b7df71bf7e1d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:22.472955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 84/176] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:22 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:22.479862 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f8d2b-1558-46b2-b05b-b7df71bf7e1d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:22.505525 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:22.511324 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 93/177] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:22.517267 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4027470-491f-43d7-87fc-be8774e9e00a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:22.644940 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4027470-491f-43d7-87fc-be8774e9e00a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:22.684625 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d907c20-cc24-4e22-b86d-b5ae1901a1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:22.685546 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d907c20-cc24-4e22-b86d-b5ae1901a1b2 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:22.685828 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d907c20-cc24-4e22-b86d-b5ae1901a1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:22.686102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d907c20-cc24-4e22-b86d-b5ae1901a1b2 None admin] PATH_INFO: `/v3/projects/cd29d2e9470f41e3b1d390f9282a22b3` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:22.689999 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d907c20-cc24-4e22-b86d-b5ae1901a1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=cd29d2e9470f41e3b1d390f9282a22b3)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:22.691509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d907c20-cc24-4e22-b86d-b5ae1901a1b2 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:22.694257 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 94/178] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:22 2022] GET /identity/v3/projects/cd29d2e9470f41e3b1d390f9282a22b3 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:22.705140 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f8d2b-1558-46b2-b05b-b7df71bf7e1d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:22.707113 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c614c-f0b6-4f98-855c-109b671466f0 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:22.707399 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c614c-f0b6-4f98-855c-109b671466f0 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:22.707673 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c614c-f0b6-4f98-855c-109b671466f0 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:22.709046 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 95/179] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:22.715662 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a5cb-a6fb-4dc2-a18c-f86c847e0bcb None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:22.715876 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a5cb-a6fb-4dc2-a18c-f86c847e0bcb None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:22.716386 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a5cb-a6fb-4dc2-a18c-f86c847e0bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:22.746139 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-11b2a5cb-a6fb-4dc2-a18c-f86c847e0bcb None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:22.748053 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-11b2a5cb-a6fb-4dc2-a18c-f86c847e0bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:22.791019 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:22.807423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36286b4d-cf21-42e8-ab19-172b6c7de71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:22.809619 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36286b4d-cf21-42e8-ab19-172b6c7de71f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:22.809619 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36286b4d-cf21-42e8-ab19-172b6c7de71f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:22.809619 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36286b4d-cf21-42e8-ab19-172b6c7de71f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:22.809619 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36286b4d-cf21-42e8-ab19-172b6c7de71f None admin] RBAC: Adding query filter params (role.id=5782703fc53f48f28fb7015ae693cd60, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9, user.id=1ffb3d4925534295a000d01ee5969114) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:22.810029 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36286b4d-cf21-42e8-ab19-172b6c7de71f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:22.811647 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36286b4d-cf21-42e8-ab19-172b6c7de71f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:22.825333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 85/180] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:22 2022] GET /identity/v3/role_assignments?user.id=1ffb3d4925534295a000d01ee5969114&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=5782703fc53f48f28fb7015ae693cd60 => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:22.828152 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36286b4d-cf21-42e8-ab19-172b6c7de71f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:22.851686 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:22.874777 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 96/181] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:22.918046 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2a5cb-a6fb-4dc2-a18c-f86c847e0bcb None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:23.056618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2a5cb-a6fb-4dc2-a18c-f86c847e0bcb None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:23.086501 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36286b4d-cf21-42e8-ab19-172b6c7de71f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:23.106721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda86aee-749a-4e67-b0b1-6174e86270ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:23.106721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda86aee-749a-4e67-b0b1-6174e86270ee None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.106721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda86aee-749a-4e67-b0b1-6174e86270ee None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.106721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda86aee-749a-4e67-b0b1-6174e86270ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.123298 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda86aee-749a-4e67-b0b1-6174e86270ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-fda86aee-749a-4e67-b0b1-6174e86270ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:23.131480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:23.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:23.133101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:23.134911 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 97/182] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:23.147748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda86aee-749a-4e67-b0b1-6174e86270ee None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:23.185366 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e390d-4c78-4127-a77a-71f25e4a7c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:23.186735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e390d-4c78-4127-a77a-71f25e4a7c90 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.187256 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e390d-4c78-4127-a77a-71f25e4a7c90 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.187729 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e390d-4c78-4127-a77a-71f25e4a7c90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.188809 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e390d-4c78-4127-a77a-71f25e4a7c90 None admin] RBAC: Adding query filter params (role.id=3ce491f94839419ea9ba3b84324fcd8f, scope.project.id=cd29d2e9470f41e3b1d390f9282a22b3, user.id=1ffb3d4925534295a000d01ee5969114) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:23.189328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e390d-4c78-4127-a77a-71f25e4a7c90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:23.191264 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e390d-4c78-4127-a77a-71f25e4a7c90 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:23.204889 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 86/183] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:22 2022] GET /identity/v3/role_assignments?user.id=1ffb3d4925534295a000d01ee5969114&scope.project.id=cd29d2e9470f41e3b1d390f9282a22b3&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 608 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:23.206124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948a76a-86e3-48bd-a1fc-be71b0ce0caf None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.206336 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948a76a-86e3-48bd-a1fc-be71b0ce0caf None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.206614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948a76a-86e3-48bd-a1fc-be71b0ce0caf None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.208248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 87/184] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:23.215038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5651f-aeb4-4712-acdf-f048eb95a7c8 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.215365 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5651f-aeb4-4712-acdf-f048eb95a7c8 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.215602 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5651f-aeb4-4712-acdf-f048eb95a7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.251249 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-c4c5651f-aeb4-4712-acdf-f048eb95a7c8 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:23.251443 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:23.252585 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-c4c5651f-aeb4-4712-acdf-f048eb95a7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:23.307586 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda86aee-749a-4e67-b0b1-6174e86270ee None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:23.354993 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:23.357247 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc7e7e-9cfd-468e-b643-5e2fc4bfbf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:23.358457 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7e7e-9cfd-468e-b643-5e2fc4bfbf65 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.358965 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7e7e-9cfd-468e-b643-5e2fc4bfbf65 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.359605 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7e7e-9cfd-468e-b643-5e2fc4bfbf65 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.360966 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc7e7e-9cfd-468e-b643-5e2fc4bfbf65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:23.361718 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc7e7e-9cfd-468e-b643-5e2fc4bfbf65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:23.363870 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc7e7e-9cfd-468e-b643-5e2fc4bfbf65 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:23.366195 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 88/185] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:23.368610 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c3e78-bb7f-4b34-91ce-7d638ba13d60 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.368965 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c3e78-bb7f-4b34-91ce-7d638ba13d60 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.378786 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c3e78-bb7f-4b34-91ce-7d638ba13d60 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.378786 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 89/186] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:23.378965 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 98/187] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:23.380493 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8975b9-dd2c-4232-aa9c-902f863ae234 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.380786 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8975b9-dd2c-4232-aa9c-902f863ae234 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.381070 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8975b9-dd2c-4232-aa9c-902f863ae234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.383873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc7e7e-9cfd-468e-b643-5e2fc4bfbf65 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:23.402947 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-ca8975b9-dd2c-4232-aa9c-902f863ae234 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:23.404799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-ca8975b9-dd2c-4232-aa9c-902f863ae234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:23.509742 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 90/188] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:23.510610 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8975b9-dd2c-4232-aa9c-902f863ae234 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:23.543256 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc7e7e-9cfd-468e-b643-5e2fc4bfbf65 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:23.565205 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:23.582386 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9d403-2075-46c6-92c5-9fadf826d600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:23.583308 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d403-2075-46c6-92c5-9fadf826d600 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.583582 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d403-2075-46c6-92c5-9fadf826d600 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.584121 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d403-2075-46c6-92c5-9fadf826d600 None admin] PATH_INFO: `/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.597983 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9d403-2075-46c6-92c5-9fadf826d600 None admin] RBAC: Authorizing `identity:get_user(user_id=5d1b2e5bb1f542e1a563ccd34b5bb131)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:23.599494 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9d403-2075-46c6-92c5-9fadf826d600 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:23.602069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 99/189] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:23 2022] GET /identity/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:23.602874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9d403-2075-46c6-92c5-9fadf826d600 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:23.650106 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8975b9-dd2c-4232-aa9c-902f863ae234 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:23.671003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:23.685719 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe5fc9-abed-4e1b-95c5-3fa3485c31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:23.687884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe5fc9-abed-4e1b-95c5-3fa3485c31d9 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.687884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe5fc9-abed-4e1b-95c5-3fa3485c31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.687884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe5fc9-abed-4e1b-95c5-3fa3485c31d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.698186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe5fc9-abed-4e1b-95c5-3fa3485c31d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-f7fe5fc9-abed-4e1b-95c5-3fa3485c31d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:23.706014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:23.706915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 91/190] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:23.712848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe5fc9-abed-4e1b-95c5-3fa3485c31d9 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:23.720871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9d403-2075-46c6-92c5-9fadf826d600 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:23.755232 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef672c-cfc7-4049-b0bb-b53e0df31e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:23.756040 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef672c-cfc7-4049-b0bb-b53e0df31e5d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.756329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef672c-cfc7-4049-b0bb-b53e0df31e5d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.756613 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef672c-cfc7-4049-b0bb-b53e0df31e5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.766762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef672c-cfc7-4049-b0bb-b53e0df31e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-c6ef672c-cfc7-4049-b0bb-b53e0df31e5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:23.774884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:23.775845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:23.776626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 100/191] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:23.777689 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459f7c-b260-4254-a42b-aefd16835258 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.777689 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459f7c-b260-4254-a42b-aefd16835258 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.777961 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459f7c-b260-4254-a42b-aefd16835258 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.780477 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 101/192] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:23.780596 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4459f7c-b260-4254-a42b-aefd16835258 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:23.815475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe5fc9-abed-4e1b-95c5-3fa3485c31d9 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:23.819139 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:23.849756 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1247af-2b2d-41ab-8814-1483a325c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:23.850411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1247af-2b2d-41ab-8814-1483a325c254 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.850727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1247af-2b2d-41ab-8814-1483a325c254 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.851000 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1247af-2b2d-41ab-8814-1483a325c254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.891468 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4459f7c-b260-4254-a42b-aefd16835258 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:23.908613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:23.930815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821950-2160-491d-81b5-a84b49db90a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:23.931495 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821950-2160-491d-81b5-a84b49db90a0 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:23.931785 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821950-2160-491d-81b5-a84b49db90a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:23.932067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821950-2160-491d-81b5-a84b49db90a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:23.932824 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62821950-2160-491d-81b5-a84b49db90a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:23.933136 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62821950-2160-491d-81b5-a84b49db90a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:23.933955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1247af-2b2d-41ab-8814-1483a325c254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:23.934530 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62821950-2160-491d-81b5-a84b49db90a0 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:23.935663 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1247af-2b2d-41ab-8814-1483a325c254 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:23.943553 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 102/193] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:23.944459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821950-2160-491d-81b5-a84b49db90a0 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:24.039278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 92/194] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:24.040710 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7d06-6c53-4622-9280-f7beea40d4e5 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:24.041003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7d06-6c53-4622-9280-f7beea40d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:24.041282 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7d06-6c53-4622-9280-f7beea40d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:24.052321 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:24.056917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-04cf7d06-6c53-4622-9280-f7beea40d4e5 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:24.060700 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821950-2160-491d-81b5-a84b49db90a0 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:24.060823 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-04cf7d06-6c53-4622-9280-f7beea40d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:24.092907 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804bf2-4717-4ce4-a7a4-d9792b829b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:24.093506 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804bf2-4717-4ce4-a7a4-d9792b829b94 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:24.093792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804bf2-4717-4ce4-a7a4-d9792b829b94 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:24.094069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804bf2-4717-4ce4-a7a4-d9792b829b94 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:24.094841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79804bf2-4717-4ce4-a7a4-d9792b829b94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:24.095155 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79804bf2-4717-4ce4-a7a4-d9792b829b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:24.096544 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79804bf2-4717-4ce4-a7a4-d9792b829b94 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:24.104469 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 103/195] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:24.105242 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804bf2-4717-4ce4-a7a4-d9792b829b94 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:24.127198 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 93/196] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:24.128048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf7d06-6c53-4622-9280-f7beea40d4e5 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:24.140686 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:24.215482 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804bf2-4717-4ce4-a7a4-d9792b829b94 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:24.228447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf7d06-6c53-4622-9280-f7beea40d4e5 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:24.248466 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f293-7e31-44ee-b4ef-69f876f53d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:24.249337 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f293-7e31-44ee-b4ef-69f876f53d84 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:24.249619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f293-7e31-44ee-b4ef-69f876f53d84 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:24.249894 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f293-7e31-44ee-b4ef-69f876f53d84 None admin] PATH_INFO: `/v3/users/5744f36e03d24fac9c4176c9d5fdab3b` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:24.251118 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1f293-7e31-44ee-b4ef-69f876f53d84 None admin] RBAC: Authorizing `identity:get_user(user_id=5744f36e03d24fac9c4176c9d5fdab3b)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:24.252564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1f293-7e31-44ee-b4ef-69f876f53d84 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:24.254445 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 104/197] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:24 2022] GET /identity/v3/users/5744f36e03d24fac9c4176c9d5fdab3b => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:24.259009 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f293-7e31-44ee-b4ef-69f876f53d84 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:24.262078 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d24e5-514d-4874-a16d-2e43750460f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:24.263549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d24e5-514d-4874-a16d-2e43750460f9 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:24.264051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d24e5-514d-4874-a16d-2e43750460f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:24.264375 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d24e5-514d-4874-a16d-2e43750460f9 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:24.265577 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d24e5-514d-4874-a16d-2e43750460f9 None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:24.267067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d24e5-514d-4874-a16d-2e43750460f9 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:24.268750 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 94/198] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:24 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:24.268750 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d24e5-514d-4874-a16d-2e43750460f9 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:24.284761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:24.351139 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:24.360159 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f293-7e31-44ee-b4ef-69f876f53d84 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:24.371881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d24e5-514d-4874-a16d-2e43750460f9 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:24.395106 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c784488-1bdd-4e3e-8cc6-7631a5df0649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:24.395983 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c784488-1bdd-4e3e-8cc6-7631a5df0649 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:24.396368 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c784488-1bdd-4e3e-8cc6-7631a5df0649 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:24.396650 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c784488-1bdd-4e3e-8cc6-7631a5df0649 None admin] PATH_INFO: `/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:24.397849 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c784488-1bdd-4e3e-8cc6-7631a5df0649 None admin] RBAC: Authorizing `identity:get_user(user_id=5d1b2e5bb1f542e1a563ccd34b5bb131)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:24.399363 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c784488-1bdd-4e3e-8cc6-7631a5df0649 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:24.401159 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 105/199] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:24 2022] GET /identity/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:24.406203 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c784488-1bdd-4e3e-8cc6-7631a5df0649 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:24.407021 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babc489-f94c-40f1-a2c7-128b2f53c051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:24.407815 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babc489-f94c-40f1-a2c7-128b2f53c051 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:24.408095 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babc489-f94c-40f1-a2c7-128b2f53c051 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:24.408369 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babc489-f94c-40f1-a2c7-128b2f53c051 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:24.409534 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babc489-f94c-40f1-a2c7-128b2f53c051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:24.410997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babc489-f94c-40f1-a2c7-128b2f53c051 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:24.412604 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 95/200] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:15:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:24.413355 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babc489-f94c-40f1-a2c7-128b2f53c051 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:24.498379 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:24.505023 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c784488-1bdd-4e3e-8cc6-7631a5df0649 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:24.510976 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babc489-f94c-40f1-a2c7-128b2f53c051 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:24.540489 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1324314-df16-4a17-b1a2-c9c44421416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:24.541142 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1324314-df16-4a17-b1a2-c9c44421416d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:24.541427 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1324314-df16-4a17-b1a2-c9c44421416d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:24.541709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1324314-df16-4a17-b1a2-c9c44421416d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:24.546026 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3506c-6f40-4037-9a71-dc08901640f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:24.546699 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3506c-6f40-4037-9a71-dc08901640f7 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:24.546982 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3506c-6f40-4037-9a71-dc08901640f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:24.547254 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3506c-6f40-4037-9a71-dc08901640f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:24.548084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3506c-6f40-4037-9a71-dc08901640f7 None admin] RBAC: Adding query filter params (role.id=61482861f00e45048fc1d45570c4c99b, scope.project.id=eab201cd44aa434290a1342e2a40c316, user.id=5d1b2e5bb1f542e1a563ccd34b5bb131) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:24.548401 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3506c-6f40-4037-9a71-dc08901640f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:24.549863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3506c-6f40-4037-9a71-dc08901640f7 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:24.555457 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 96/201] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:24 2022] GET /identity/v3/role_assignments?user.id=5d1b2e5bb1f542e1a563ccd34b5bb131&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=61482861f00e45048fc1d45570c4c99b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:24.556257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3506c-6f40-4037-9a71-dc08901640f7 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:24.587486 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:24.620573 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1324314-df16-4a17-b1a2-c9c44421416d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:24.622012 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1324314-df16-4a17-b1a2-c9c44421416d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:24.692049 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3506c-6f40-4037-9a71-dc08901640f7 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:24.731200 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:24.731691 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dd809-4dfb-4322-abf3-d1253f110317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:24.732983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd809-4dfb-4322-abf3-d1253f110317 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:24.733566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd809-4dfb-4322-abf3-d1253f110317 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:24.733855 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd809-4dfb-4322-abf3-d1253f110317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:24.738817 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 106/202] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:24.742825 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1324314-df16-4a17-b1a2-c9c44421416d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:24.813148 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dd809-4dfb-4322-abf3-d1253f110317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:24.814835 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dd809-4dfb-4322-abf3-d1253f110317 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:24.827318 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:24.851117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1324314-df16-4a17-b1a2-c9c44421416d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:24.895778 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a0ad1-355e-4292-8ea7-6dec27658d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:24.896461 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a0ad1-355e-4292-8ea7-6dec27658d39 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:24.896742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a0ad1-355e-4292-8ea7-6dec27658d39 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:24.897025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a0ad1-355e-4292-8ea7-6dec27658d39 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:24.897739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a0ad1-355e-4292-8ea7-6dec27658d39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:24.899417 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a0ad1-355e-4292-8ea7-6dec27658d39 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:24.922734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 97/203] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:24.922734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dd809-4dfb-4322-abf3-d1253f110317 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:25.006027 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 107/204] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:15:24 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:15:25.007181 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a0ad1-355e-4292-8ea7-6dec27658d39 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:25.032274 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dd809-4dfb-4322-abf3-d1253f110317 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:25.046928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:25.071586 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:25.082178 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b9cbb-ac0a-4d32-b622-3c6153c52ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:25.084157 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b9cbb-ac0a-4d32-b622-3c6153c52ac7 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:25.084684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b9cbb-ac0a-4d32-b622-3c6153c52ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:25.085110 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b9cbb-ac0a-4d32-b622-3c6153c52ac7 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:25.087736 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b9cbb-ac0a-4d32-b622-3c6153c52ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:25.089446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b9cbb-ac0a-4d32-b622-3c6153c52ac7 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:25.097240 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 98/205] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:24 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:25.098501 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b9cbb-ac0a-4d32-b622-3c6153c52ac7 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:25.145875 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a0ad1-355e-4292-8ea7-6dec27658d39 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:25.189878 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47c8b0-af26-49de-ac8e-51a8433c41c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:25.191430 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47c8b0-af26-49de-ac8e-51a8433c41c5 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:25.191430 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47c8b0-af26-49de-ac8e-51a8433c41c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:25.191622 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47c8b0-af26-49de-ac8e-51a8433c41c5 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:25.192742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47c8b0-af26-49de-ac8e-51a8433c41c5 None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:25.194297 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47c8b0-af26-49de-ac8e-51a8433c41c5 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:25.196174 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 108/206] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:25 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:25.203030 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47c8b0-af26-49de-ac8e-51a8433c41c5 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:25.235581 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b9cbb-ac0a-4d32-b622-3c6153c52ac7 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:25.283135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd73d0-c5c2-4687-a4fe-eb7a0ffe6778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:25.284254 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd73d0-c5c2-4687-a4fe-eb7a0ffe6778 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:25.285451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd73d0-c5c2-4687-a4fe-eb7a0ffe6778 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:25.285870 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd73d0-c5c2-4687-a4fe-eb7a0ffe6778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:25.286880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd73d0-c5c2-4687-a4fe-eb7a0ffe6778 None admin] RBAC: Adding query filter params (role.id=cfd002a6d7564425bfaa1379d4b2c562, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9, user.id=5744f36e03d24fac9c4176c9d5fdab3b) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:25.288019 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd73d0-c5c2-4687-a4fe-eb7a0ffe6778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:25.289855 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd73d0-c5c2-4687-a4fe-eb7a0ffe6778 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:25.299103 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 99/207] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:25 2022] GET /identity/v3/role_assignments?user.id=5744f36e03d24fac9c4176c9d5fdab3b&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=cfd002a6d7564425bfaa1379d4b2c562 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:25.347696 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47c8b0-af26-49de-ac8e-51a8433c41c5 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:25.370820 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:25.388695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d726ee6-6917-499c-904e-52a26f4751d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:25.393062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d726ee6-6917-499c-904e-52a26f4751d0 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:25.393062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d726ee6-6917-499c-904e-52a26f4751d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:25.393062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d726ee6-6917-499c-904e-52a26f4751d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:25.393062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d726ee6-6917-499c-904e-52a26f4751d0 None admin] RBAC: Adding query filter params (role.id=5782703fc53f48f28fb7015ae693cd60, scope.project.id=eab201cd44aa434290a1342e2a40c316, user.id=5d1b2e5bb1f542e1a563ccd34b5bb131) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:25.393062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d726ee6-6917-499c-904e-52a26f4751d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:25.393062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d726ee6-6917-499c-904e-52a26f4751d0 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:25.399443 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 109/208] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:25 2022] GET /identity/v3/role_assignments?user.id=5d1b2e5bb1f542e1a563ccd34b5bb131&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=5782703fc53f48f28fb7015ae693cd60 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:26.953341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35b7b4-5fbb-41f0-bbbe-40d2f5b2ed5d None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:26.953878 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35b7b4-5fbb-41f0-bbbe-40d2f5b2ed5d None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:26.953878 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35b7b4-5fbb-41f0-bbbe-40d2f5b2ed5d None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:26.955371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 100/209] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:26.960802 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3db60-cafc-44f9-b0dc-4a55c5fb2ba6 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:26.961620 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3db60-cafc-44f9-b0dc-4a55c5fb2ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:26.962120 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3db60-cafc-44f9-b0dc-4a55c5fb2ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:26.979945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-cbf3db60-cafc-44f9-b0dc-4a55c5fb2ba6 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:26.981446 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-cbf3db60-cafc-44f9-b0dc-4a55c5fb2ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:27.055175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 110/210] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:27.080923 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35b7b4-5fbb-41f0-bbbe-40d2f5b2ed5d None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:27.130492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:27.196184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35b7b4-5fbb-41f0-bbbe-40d2f5b2ed5d None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:27.232176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f617a3-6fd6-4c9f-8e45-4de89a83f4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:27.232988 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f617a3-6fd6-4c9f-8e45-4de89a83f4d2 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:27.233338 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f617a3-6fd6-4c9f-8e45-4de89a83f4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:27.233533 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f617a3-6fd6-4c9f-8e45-4de89a83f4d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:27.244492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f617a3-6fd6-4c9f-8e45-4de89a83f4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-90f617a3-6fd6-4c9f-8e45-4de89a83f4d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:27.252992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:27.253880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:27.254942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 101/211] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:27.260362 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3db60-cafc-44f9-b0dc-4a55c5fb2ba6 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:27.380366 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3db60-cafc-44f9-b0dc-4a55c5fb2ba6 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:27.396337 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:27.418983 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc015a-cbd0-48a2-a9fb-1570766c327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:27.420625 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc015a-cbd0-48a2-a9fb-1570766c327c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:27.421157 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc015a-cbd0-48a2-a9fb-1570766c327c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:27.421443 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc015a-cbd0-48a2-a9fb-1570766c327c None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:27.422214 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc015a-cbd0-48a2-a9fb-1570766c327c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:27.422529 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc015a-cbd0-48a2-a9fb-1570766c327c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:27.424017 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc015a-cbd0-48a2-a9fb-1570766c327c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:27.433146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 111/212] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:27.439235 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f617a3-6fd6-4c9f-8e45-4de89a83f4d2 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:27.549985 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f617a3-6fd6-4c9f-8e45-4de89a83f4d2 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:27.551520 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:27.587697 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9173c4f-a04b-4e6e-b32c-f2ac61001171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:27.588614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9173c4f-a04b-4e6e-b32c-f2ac61001171 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:27.588900 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9173c4f-a04b-4e6e-b32c-f2ac61001171 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:27.589182 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9173c4f-a04b-4e6e-b32c-f2ac61001171 None admin] PATH_INFO: `/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:27.590535 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9173c4f-a04b-4e6e-b32c-f2ac61001171 None admin] RBAC: Authorizing `identity:get_user(user_id=5d1b2e5bb1f542e1a563ccd34b5bb131)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:27.593077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9173c4f-a04b-4e6e-b32c-f2ac61001171 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:27.595309 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 102/213] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:27 2022] GET /identity/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:27.601037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc015a-cbd0-48a2-a9fb-1570766c327c None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:27.693373 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dacbc0-fbb7-4c83-a03c-fd3aebc5aa28 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:27.694007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dacbc0-fbb7-4c83-a03c-fd3aebc5aa28 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:27.694485 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dacbc0-fbb7-4c83-a03c-fd3aebc5aa28 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:27.696131 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 103/214] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:15:27.702481 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d244a6-9a42-4f06-be82-e492bd64e6c4 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:27.703052 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d244a6-9a42-4f06-be82-e492bd64e6c4 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:27.703547 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d244a6-9a42-4f06-be82-e492bd64e6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:27.718019 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc015a-cbd0-48a2-a9fb-1570766c327c None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:27.723342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-e9d244a6-9a42-4f06-be82-e492bd64e6c4 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:27.724635 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-e9d244a6-9a42-4f06-be82-e492bd64e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:27.760886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d013e-3a98-40ec-939a-feda7640fbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:27.761751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d013e-3a98-40ec-939a-feda7640fbbd None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:27.762725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d013e-3a98-40ec-939a-feda7640fbbd None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:27.762725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d013e-3a98-40ec-939a-feda7640fbbd None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:27.764570 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d013e-3a98-40ec-939a-feda7640fbbd None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:27.766044 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d013e-3a98-40ec-939a-feda7640fbbd None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:27.767938 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 112/215] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:27 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:27.769270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f623d-5861-4fb8-ab12-dd9ea09e02e5 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:27.769558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f623d-5861-4fb8-ab12-dd9ea09e02e5 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:27.769834 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f623d-5861-4fb8-ab12-dd9ea09e02e5 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:27.774783 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 113/216] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:27.775690 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f623d-5861-4fb8-ab12-dd9ea09e02e5 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:27.802017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 104/217] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:27.808893 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586a3fe-4c73-4260-a7e3-8c1760dcae97 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:27.809332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586a3fe-4c73-4260-a7e3-8c1760dcae97 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:27.809800 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586a3fe-4c73-4260-a7e3-8c1760dcae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:27.826400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:27.831701 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-e586a3fe-4c73-4260-a7e3-8c1760dcae97 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:27.832892 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-e586a3fe-4c73-4260-a7e3-8c1760dcae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:27.898050 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f623d-5861-4fb8-ab12-dd9ea09e02e5 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:27.910177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 105/218] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:27.911277 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586a3fe-4c73-4260-a7e3-8c1760dcae97 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:27.942377 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:27.947236 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3497fc-a4aa-4011-9543-79fff4e1af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:27.948142 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3497fc-a4aa-4011-9543-79fff4e1af95 None admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:27.948450 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3497fc-a4aa-4011-9543-79fff4e1af95 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:27.948729 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3497fc-a4aa-4011-9543-79fff4e1af95 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316/users/5d1b2e5bb1f542e1a563ccd34b5bb131/roles/61482861f00e45048fc1d45570c4c99b` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:27.951432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3497fc-a4aa-4011-9543-79fff4e1af95 None admin] RBAC: Authorizing `identity:create_grant(project_id=eab201cd44aa434290a1342e2a40c316, user_id=5d1b2e5bb1f542e1a563ccd34b5bb131, role_id=61482861f00e45048fc1d45570c4c99b)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:27.953037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3497fc-a4aa-4011-9543-79fff4e1af95 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:28.010534 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586a3fe-4c73-4260-a7e3-8c1760dcae97 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:28.042222 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 114/219] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:15:27 2022] PUT /identity/v3/projects/eab201cd44aa434290a1342e2a40c316/users/5d1b2e5bb1f542e1a563ccd34b5bb131/roles/61482861f00e45048fc1d45570c4c99b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:28.043166 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3497fc-a4aa-4011-9543-79fff4e1af95 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:28.048596 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd1bea-51c4-4c7c-a0ee-fe002b15aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:28.049456 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1bea-51c4-4c7c-a0ee-fe002b15aa67 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:28.049943 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1bea-51c4-4c7c-a0ee-fe002b15aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:28.050220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1bea-51c4-4c7c-a0ee-fe002b15aa67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:28.065646 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd1bea-51c4-4c7c-a0ee-fe002b15aa67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-30bd1bea-51c4-4c7c-a0ee-fe002b15aa67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:28.073658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:28.074979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:28.076497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 106/220] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:28.077161 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5af1a-92b5-4740-bbc6-70cc0916f8d2 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:28.077595 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5af1a-92b5-4740-bbc6-70cc0916f8d2 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:28.077595 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5af1a-92b5-4740-bbc6-70cc0916f8d2 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:28.082785 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 107/221] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:28.082785 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5af1a-92b5-4740-bbc6-70cc0916f8d2 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:28.176513 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3497fc-a4aa-4011-9543-79fff4e1af95 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:28.178376 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:28.197077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:28.209400 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5af1a-92b5-4740-bbc6-70cc0916f8d2 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:28.217930 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd642ae2-bf58-4909-a2c7-dde16066bce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:28.218316 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd642ae2-bf58-4909-a2c7-dde16066bce8 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:28.218603 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd642ae2-bf58-4909-a2c7-dde16066bce8 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:28.218934 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd642ae2-bf58-4909-a2c7-dde16066bce8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:28.220322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd642ae2-bf58-4909-a2c7-dde16066bce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:28.221822 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd642ae2-bf58-4909-a2c7-dde16066bce8 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:28.225937 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 115/222] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:15:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:28.225937 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023f59-73c2-41f8-9624-f7272b36c892 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:28.225937 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023f59-73c2-41f8-9624-f7272b36c892 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:28.225937 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023f59-73c2-41f8-9624-f7272b36c892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:28.248703 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-eb023f59-73c2-41f8-9624-f7272b36c892 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:28.249908 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-eb023f59-73c2-41f8-9624-f7272b36c892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:28.260275 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d8456-ce0d-406e-bb80-43ad42da7027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:28.261004 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d8456-ce0d-406e-bb80-43ad42da7027 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:28.261288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d8456-ce0d-406e-bb80-43ad42da7027 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:28.261564 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d8456-ce0d-406e-bb80-43ad42da7027 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:28.262389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d8456-ce0d-406e-bb80-43ad42da7027 None admin] RBAC: Adding query filter params (name=member) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:28.262815 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d8456-ce0d-406e-bb80-43ad42da7027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:28.264521 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d8456-ce0d-406e-bb80-43ad42da7027 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:28.274835 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 108/223] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:28.274835 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d8456-ce0d-406e-bb80-43ad42da7027 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:28.326599 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 116/224] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:28.333266 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb023f59-73c2-41f8-9624-f7272b36c892 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:28.389467 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d8456-ce0d-406e-bb80-43ad42da7027 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:28.425356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e234b-f7f0-47a3-accc-bb7905b4b13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:28.426135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e234b-f7f0-47a3-accc-bb7905b4b13d None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:28.426568 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e234b-f7f0-47a3-accc-bb7905b4b13d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:28.426932 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e234b-f7f0-47a3-accc-bb7905b4b13d None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:28.427711 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e234b-f7f0-47a3-accc-bb7905b4b13d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:28.429349 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e234b-f7f0-47a3-accc-bb7905b4b13d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:28.442007 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:28.445444 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb023f59-73c2-41f8-9624-f7272b36c892 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:28.479785 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c457d1a-72ca-4a0c-8929-848f57d001ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:28.480660 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c457d1a-72ca-4a0c-8929-848f57d001ce None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:28.480958 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c457d1a-72ca-4a0c-8929-848f57d001ce None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:28.481217 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c457d1a-72ca-4a0c-8929-848f57d001ce None admin] PATH_INFO: `/v3/users/7a464e70d07d4acaa9a51aa75084072e` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:28.495724 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c457d1a-72ca-4a0c-8929-848f57d001ce None admin] RBAC: Authorizing `identity:get_user(user_id=7a464e70d07d4acaa9a51aa75084072e)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:28.497849 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c457d1a-72ca-4a0c-8929-848f57d001ce None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:28.500033 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 117/225] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:28 2022] GET /identity/v3/users/7a464e70d07d4acaa9a51aa75084072e => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:28.500564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c457d1a-72ca-4a0c-8929-848f57d001ce None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:28.566814 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 109/226] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:15:28 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:15:28.566814 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e234b-f7f0-47a3-accc-bb7905b4b13d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:28.578725 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:28.633190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c457d1a-72ca-4a0c-8929-848f57d001ce None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:28.674788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9beda6-44f4-4848-b163-c9f230d04218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:28.674788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9beda6-44f4-4848-b163-c9f230d04218 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:28.675060 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9beda6-44f4-4848-b163-c9f230d04218 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:28.675162 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9beda6-44f4-4848-b163-c9f230d04218 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:28.686581 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e234b-f7f0-47a3-accc-bb7905b4b13d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:28.687454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9beda6-44f4-4848-b163-c9f230d04218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-0a9beda6-44f4-4848-b163-c9f230d04218 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:28.696235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:28.697188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:28.697952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 118/227] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:28.705055 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9beda6-44f4-4848-b163-c9f230d04218 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:28.726614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fb518-37cf-49ce-825c-33e872f33878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:28.727356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fb518-37cf-49ce-825c-33e872f33878 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:28.727774 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:28.728600 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fb518-37cf-49ce-825c-33e872f33878 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:28.729031 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fb518-37cf-49ce-825c-33e872f33878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:28.817153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fb518-37cf-49ce-825c-33e872f33878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:28.819052 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fb518-37cf-49ce-825c-33e872f33878 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:28.830200 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9beda6-44f4-4848-b163-c9f230d04218 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:28.831842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:28.875637 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890ca6d-ae7f-481e-b686-e8e9918c9680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:28.875841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ca6d-ae7f-481e-b686-e8e9918c9680 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:28.876070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ca6d-ae7f-481e-b686-e8e9918c9680 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:28.876343 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ca6d-ae7f-481e-b686-e8e9918c9680 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:28.877109 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890ca6d-ae7f-481e-b686-e8e9918c9680 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:28.877428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890ca6d-ae7f-481e-b686-e8e9918c9680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:28.878876 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890ca6d-ae7f-481e-b686-e8e9918c9680 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:28.894683 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 119/228] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:28.897505 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890ca6d-ae7f-481e-b686-e8e9918c9680 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:28.958870 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 110/229] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:28.969656 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fb518-37cf-49ce-825c-33e872f33878 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:29.017893 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:29.052686 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890ca6d-ae7f-481e-b686-e8e9918c9680 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:29.096486 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c382328-5f42-40d1-add5-a47cf1728028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:29.097944 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c382328-5f42-40d1-add5-a47cf1728028 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:29.098381 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c382328-5f42-40d1-add5-a47cf1728028 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:29.098831 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c382328-5f42-40d1-add5-a47cf1728028 None admin] PATH_INFO: `/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:29.099317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fb518-37cf-49ce-825c-33e872f33878 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:29.100749 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c382328-5f42-40d1-add5-a47cf1728028 None admin] RBAC: Authorizing `identity:get_user(user_id=5d1b2e5bb1f542e1a563ccd34b5bb131)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:29.103699 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c382328-5f42-40d1-add5-a47cf1728028 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:29.105850 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 120/230] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:28 2022] GET /identity/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:29.112967 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:29.114485 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c382328-5f42-40d1-add5-a47cf1728028 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:29.142346 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb41e-f57f-4a6b-a9f7-541c633df364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:29.143731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb41e-f57f-4a6b-a9f7-541c633df364 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:29.144048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb41e-f57f-4a6b-a9f7-541c633df364 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:29.144428 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb41e-f57f-4a6b-a9f7-541c633df364 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:29.146716 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eb41e-f57f-4a6b-a9f7-541c633df364 None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:29.148688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eb41e-f57f-4a6b-a9f7-541c633df364 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:29.151116 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 111/231] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:28 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:29.164330 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb41e-f57f-4a6b-a9f7-541c633df364 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:29.261272 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c382328-5f42-40d1-add5-a47cf1728028 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:29.300857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd1a22-60fb-4328-9d60-102b4c7caeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:29.301950 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd1a22-60fb-4328-9d60-102b4c7caeae None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:29.302408 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd1a22-60fb-4328-9d60-102b4c7caeae None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:29.302852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd1a22-60fb-4328-9d60-102b4c7caeae None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:29.304320 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd1a22-60fb-4328-9d60-102b4c7caeae None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:29.306050 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd1a22-60fb-4328-9d60-102b4c7caeae None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:29.308554 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 121/232] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:29 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:29.312731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb41e-f57f-4a6b-a9f7-541c633df364 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:29.319788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd1a22-60fb-4328-9d60-102b4c7caeae None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:29.356422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:29.412025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07751d84-f01b-44c8-aac4-280bf294c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:29.412707 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07751d84-f01b-44c8-aac4-280bf294c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:29.413010 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07751d84-f01b-44c8-aac4-280bf294c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:29.413669 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07751d84-f01b-44c8-aac4-280bf294c0b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:29.414130 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07751d84-f01b-44c8-aac4-280bf294c0b5 None admin] RBAC: Adding query filter params (role.id=3ce491f94839419ea9ba3b84324fcd8f, scope.project.id=eab201cd44aa434290a1342e2a40c316, user.id=7a464e70d07d4acaa9a51aa75084072e) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:29.414447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07751d84-f01b-44c8-aac4-280bf294c0b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:29.415955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07751d84-f01b-44c8-aac4-280bf294c0b5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:29.437961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 112/233] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:29 2022] GET /identity/v3/role_assignments?user.id=7a464e70d07d4acaa9a51aa75084072e&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:29.461565 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd1a22-60fb-4328-9d60-102b4c7caeae None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:29.526278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95208f-d69e-4513-a4fb-4873d75397cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:29.527239 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95208f-d69e-4513-a4fb-4873d75397cc None admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:29.527526 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95208f-d69e-4513-a4fb-4873d75397cc None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:29.527807 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95208f-d69e-4513-a4fb-4873d75397cc None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316/users/5d1b2e5bb1f542e1a563ccd34b5bb131/roles/5782703fc53f48f28fb7015ae693cd60` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:29.532728 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95208f-d69e-4513-a4fb-4873d75397cc None admin] RBAC: Authorizing `identity:create_grant(project_id=eab201cd44aa434290a1342e2a40c316, user_id=5d1b2e5bb1f542e1a563ccd34b5bb131, role_id=5782703fc53f48f28fb7015ae693cd60)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:29.534263 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95208f-d69e-4513-a4fb-4873d75397cc None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:29.630099 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 122/234] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:15:29 2022] PUT /identity/v3/projects/eab201cd44aa434290a1342e2a40c316/users/5d1b2e5bb1f542e1a563ccd34b5bb131/roles/5782703fc53f48f28fb7015ae693cd60 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:15:30.645529 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d70a05-3265-4eea-ba98-a2648d9c2192 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:30.646039 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d70a05-3265-4eea-ba98-a2648d9c2192 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:30.646114 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d70a05-3265-4eea-ba98-a2648d9c2192 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:30.647789 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 113/235] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:30.653161 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a27b7-f70c-4b0f-837e-b6e4b9ae6d36 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:30.654109 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a27b7-f70c-4b0f-837e-b6e4b9ae6d36 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:30.654512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a27b7-f70c-4b0f-837e-b6e4b9ae6d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:30.679640 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-a47a27b7-f70c-4b0f-837e-b6e4b9ae6d36 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:30.680866 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-a47a27b7-f70c-4b0f-837e-b6e4b9ae6d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:30.768662 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 123/236] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:30.802944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d70a05-3265-4eea-ba98-a2648d9c2192 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:30.856436 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:30.944363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d70a05-3265-4eea-ba98-a2648d9c2192 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:30.995498 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a67630-34c2-4d63-860e-b13ace35b5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:30.996775 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67630-34c2-4d63-860e-b13ace35b5b8 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:30.997859 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67630-34c2-4d63-860e-b13ace35b5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:30.998341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67630-34c2-4d63-860e-b13ace35b5b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:31.018070 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a67630-34c2-4d63-860e-b13ace35b5b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-46a67630-34c2-4d63-860e-b13ace35b5b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:31.026185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:31.027086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:31.027850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:31.035132 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 114/237] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:31.040069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a27b7-f70c-4b0f-837e-b6e4b9ae6d36 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:31.053619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:31.194735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a27b7-f70c-4b0f-837e-b6e4b9ae6d36 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:31.245178 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2b27d-ae8f-47e9-b213-88bea5b1fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:31.245853 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2b27d-ae8f-47e9-b213-88bea5b1fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:31.246135 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2b27d-ae8f-47e9-b213-88bea5b1fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:31.246414 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2b27d-ae8f-47e9-b213-88bea5b1fbb0 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:31.247333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2b27d-ae8f-47e9-b213-88bea5b1fbb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:31.247563 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2b27d-ae8f-47e9-b213-88bea5b1fbb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:31.248955 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2b27d-ae8f-47e9-b213-88bea5b1fbb0 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:31.262791 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 124/238] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:31.268721 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a67630-34c2-4d63-860e-b13ace35b5b8 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:31.459971 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac8260-77d4-4a3c-9d18-25dc1c951a2d None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:31.460318 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac8260-77d4-4a3c-9d18-25dc1c951a2d None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:31.460493 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac8260-77d4-4a3c-9d18-25dc1c951a2d None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:31.461979 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 125/239] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:31.467479 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a268c5-a88d-4464-9854-fffa50745e6d None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:31.467759 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a268c5-a88d-4464-9854-fffa50745e6d None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:31.468014 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a268c5-a88d-4464-9854-fffa50745e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:31.468564 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a67630-34c2-4d63-860e-b13ace35b5b8 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:31.471770 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:31.484844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-80a268c5-a88d-4464-9854-fffa50745e6d None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:31.486048 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-80a268c5-a88d-4464-9854-fffa50745e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:31.534849 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8878561-74be-42db-9b25-38bf1a68d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:31.535738 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8878561-74be-42db-9b25-38bf1a68d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:31.536021 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8878561-74be-42db-9b25-38bf1a68d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:31.536295 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8878561-74be-42db-9b25-38bf1a68d1a0 None admin] PATH_INFO: `/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:31.538121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8878561-74be-42db-9b25-38bf1a68d1a0 None admin] RBAC: Authorizing `identity:get_user(user_id=5d1b2e5bb1f542e1a563ccd34b5bb131)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:31.539683 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8878561-74be-42db-9b25-38bf1a68d1a0 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:31.541498 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 115/240] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:31 2022] GET /identity/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:31.549181 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8878561-74be-42db-9b25-38bf1a68d1a0 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:31.589682 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:31.595373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 126/241] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:31.622267 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a268c5-a88d-4464-9854-fffa50745e6d None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:31.704060 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8878561-74be-42db-9b25-38bf1a68d1a0 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:31.738708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d3a0-69a2-4841-8f8c-1fb46f994044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:31.739283 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d3a0-69a2-4841-8f8c-1fb46f994044 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:31.739567 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d3a0-69a2-4841-8f8c-1fb46f994044 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:31.739845 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d3a0-69a2-4841-8f8c-1fb46f994044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:31.783162 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:31.809767 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5d3a0-69a2-4841-8f8c-1fb46f994044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:31.811365 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5d3a0-69a2-4841-8f8c-1fb46f994044 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:31.840860 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a268c5-a88d-4464-9854-fffa50745e6d None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:31.923502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 116/242] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:31.930273 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d3a0-69a2-4841-8f8c-1fb46f994044 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:31.969825 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acc1ae-0b38-47b4-8b42-35ddb9b749bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:31.970677 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acc1ae-0b38-47b4-8b42-35ddb9b749bb None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:31.970976 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acc1ae-0b38-47b4-8b42-35ddb9b749bb None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:31.971262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acc1ae-0b38-47b4-8b42-35ddb9b749bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:31.989608 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acc1ae-0b38-47b4-8b42-35ddb9b749bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-13acc1ae-0b38-47b4-8b42-35ddb9b749bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:31.998036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:31.998959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:31.999773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:32.008355 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 127/243] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:15:32.010170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fe150-75c9-4e37-a43a-a44a7b4f3765 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.010671 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fe150-75c9-4e37-a43a-a44a7b4f3765 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.011231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fe150-75c9-4e37-a43a-a44a7b4f3765 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.013716 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 128/244] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:32.014587 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fe150-75c9-4e37-a43a-a44a7b4f3765 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:32.021089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:32.060898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d3a0-69a2-4841-8f8c-1fb46f994044 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:32.102014 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:32.103609 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2f508-96ee-4875-babf-ec7ed0483109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:32.104770 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f508-96ee-4875-babf-ec7ed0483109 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.105223 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f508-96ee-4875-babf-ec7ed0483109 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.105648 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f508-96ee-4875-babf-ec7ed0483109 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.107641 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2f508-96ee-4875-babf-ec7ed0483109 None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:32.109416 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2f508-96ee-4875-babf-ec7ed0483109 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:32.111493 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 117/245] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:31 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:32.118134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b78be6-75b8-49b6-b403-3016f5893d17 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.118761 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b78be6-75b8-49b6-b403-3016f5893d17 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.119216 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b78be6-75b8-49b6-b403-3016f5893d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.139684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-83b78be6-75b8-49b6-b403-3016f5893d17 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:32.141289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-83b78be6-75b8-49b6-b403-3016f5893d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:32.151373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fe150-75c9-4e37-a43a-a44a7b4f3765 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:32.193922 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943efdc-a3b3-493e-8886-5cc56588f4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:32.195693 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943efdc-a3b3-493e-8886-5cc56588f4c9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.196079 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943efdc-a3b3-493e-8886-5cc56588f4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.196459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943efdc-a3b3-493e-8886-5cc56588f4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.197499 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943efdc-a3b3-493e-8886-5cc56588f4c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:32.197907 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943efdc-a3b3-493e-8886-5cc56588f4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:32.200106 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943efdc-a3b3-493e-8886-5cc56588f4c9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:32.211556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 129/246] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:32.212399 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943efdc-a3b3-493e-8886-5cc56588f4c9 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:32.222396 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 118/247] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:32.223773 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b78be6-75b8-49b6-b403-3016f5893d17 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:32.299036 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:32.344724 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b78be6-75b8-49b6-b403-3016f5893d17 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:32.345478 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943efdc-a3b3-493e-8886-5cc56588f4c9 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:32.371564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:32.389080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3a82f-e53c-4d34-a552-3b1827201d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:32.389829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3a82f-e53c-4d34-a552-3b1827201d73 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.390123 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3a82f-e53c-4d34-a552-3b1827201d73 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.390406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3a82f-e53c-4d34-a552-3b1827201d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.390975 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781374cc-8cbc-456c-93bc-6ce2a4a6d747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:32.391281 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3a82f-e53c-4d34-a552-3b1827201d73 None admin] RBAC: Adding query filter params (role.id=61482861f00e45048fc1d45570c4c99b, scope.project.id=eab201cd44aa434290a1342e2a40c316, user.id=5d1b2e5bb1f542e1a563ccd34b5bb131) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:32.391598 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3a82f-e53c-4d34-a552-3b1827201d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:32.392478 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781374cc-8cbc-456c-93bc-6ce2a4a6d747 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.392963 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781374cc-8cbc-456c-93bc-6ce2a4a6d747 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.393061 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3a82f-e53c-4d34-a552-3b1827201d73 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:32.393507 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781374cc-8cbc-456c-93bc-6ce2a4a6d747 None admin] PATH_INFO: `/v3/users/cd10c5504caa46d9993b14fd2c3dcb0e` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.400410 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 130/248] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:32 2022] GET /identity/v3/role_assignments?user.id=5d1b2e5bb1f542e1a563ccd34b5bb131&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=61482861f00e45048fc1d45570c4c99b => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:32.406904 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3a82f-e53c-4d34-a552-3b1827201d73 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:32.423787 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781374cc-8cbc-456c-93bc-6ce2a4a6d747 None admin] RBAC: Authorizing `identity:get_user(user_id=cd10c5504caa46d9993b14fd2c3dcb0e)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:32.425880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781374cc-8cbc-456c-93bc-6ce2a4a6d747 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:32.429327 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 119/249] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:32 2022] GET /identity/v3/users/cd10c5504caa46d9993b14fd2c3dcb0e => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:32.435378 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781374cc-8cbc-456c-93bc-6ce2a4a6d747 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:32.520904 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3a82f-e53c-4d34-a552-3b1827201d73 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:32.559409 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9bd91-b71d-40a6-a4fc-0ee210aac57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:32.560195 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9bd91-b71d-40a6-a4fc-0ee210aac57a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.560483 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9bd91-b71d-40a6-a4fc-0ee210aac57a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.560837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9bd91-b71d-40a6-a4fc-0ee210aac57a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.562248 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9bd91-b71d-40a6-a4fc-0ee210aac57a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:32.563776 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9bd91-b71d-40a6-a4fc-0ee210aac57a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:32.565764 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 131/250] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:15:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:32.566937 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6f29d-b535-4cd4-b3c1-f81bb7000f7b None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.567229 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6f29d-b535-4cd4-b3c1-f81bb7000f7b None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.567510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6f29d-b535-4cd4-b3c1-f81bb7000f7b None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.568848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 132/251] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:32.575151 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6f29d-b535-4cd4-b3c1-f81bb7000f7b None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:32.579063 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781374cc-8cbc-456c-93bc-6ce2a4a6d747 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:32.611017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:32.619256 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2c2c1-c07d-4aa1-9b51-d3f4acd92374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:32.624694 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2c2c1-c07d-4aa1-9b51-d3f4acd92374 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.624694 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2c2c1-c07d-4aa1-9b51-d3f4acd92374 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.624694 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2c2c1-c07d-4aa1-9b51-d3f4acd92374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.637157 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:32.693429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6f29d-b535-4cd4-b3c1-f81bb7000f7b None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:32.700610 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2c2c1-c07d-4aa1-9b51-d3f4acd92374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:32.702448 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2c2c1-c07d-4aa1-9b51-d3f4acd92374 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:32.731804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72660d7-7288-4557-948e-90753b87b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:32.732484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72660d7-7288-4557-948e-90753b87b370 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.732768 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72660d7-7288-4557-948e-90753b87b370 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.733043 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72660d7-7288-4557-948e-90753b87b370 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.733760 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72660d7-7288-4557-948e-90753b87b370 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:32.735250 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72660d7-7288-4557-948e-90753b87b370 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:32.807935 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 120/252] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:32.809233 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba525ed-09ae-4fa6-ad27-aa3b227da3e6 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.810057 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba525ed-09ae-4fa6-ad27-aa3b227da3e6 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.810367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba525ed-09ae-4fa6-ad27-aa3b227da3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.826449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-4ba525ed-09ae-4fa6-ad27-aa3b227da3e6 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:32.827665 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-4ba525ed-09ae-4fa6-ad27-aa3b227da3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:32.845600 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:32.848557 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 133/253] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:15:32 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:15:32.862350 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bdf57-b16c-4997-932c-6f0c0dc26a94 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.862706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bdf57-b16c-4997-932c-6f0c0dc26a94 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.863104 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bdf57-b16c-4997-932c-6f0c0dc26a94 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.864780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 134/254] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:32.865469 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bdf57-b16c-4997-932c-6f0c0dc26a94 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:32.915864 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 121/255] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:32.921268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4e418-91dc-4fed-b13b-ba6281771779 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:32.923059 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4e418-91dc-4fed-b13b-ba6281771779 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:32.923445 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4e418-91dc-4fed-b13b-ba6281771779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:32.947217 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-3fb4e418-91dc-4fed-b13b-ba6281771779 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:32.948588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-3fb4e418-91dc-4fed-b13b-ba6281771779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:33.001575 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bdf57-b16c-4997-932c-6f0c0dc26a94 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:33.012419 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:33.032284 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 122/256] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:33.042140 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4e418-91dc-4fed-b13b-ba6281771779 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:33.047393 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f7dae-a084-4f72-9d61-985d9a4b4acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:33.048281 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f7dae-a084-4f72-9d61-985d9a4b4acf None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:33.048574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f7dae-a084-4f72-9d61-985d9a4b4acf None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:33.048851 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f7dae-a084-4f72-9d61-985d9a4b4acf None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:33.052004 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f7dae-a084-4f72-9d61-985d9a4b4acf None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:33.057091 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f7dae-a084-4f72-9d61-985d9a4b4acf None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:33.057091 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 135/257] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:32 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:33.060747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f7dae-a084-4f72-9d61-985d9a4b4acf None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:33.152244 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:33.172405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4e418-91dc-4fed-b13b-ba6281771779 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:33.193207 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f7dae-a084-4f72-9d61-985d9a4b4acf None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:33.216178 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adbc2b-3535-4016-a96a-9efdb39d3348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:33.217262 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbc2b-3535-4016-a96a-9efdb39d3348 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:33.217546 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbc2b-3535-4016-a96a-9efdb39d3348 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:33.217824 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbc2b-3535-4016-a96a-9efdb39d3348 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:33.234403 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adbc2b-3535-4016-a96a-9efdb39d3348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:33.236859 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b54dc0-adc2-4ed3-b44f-4035fc585ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:33.237679 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b54dc0-adc2-4ed3-b44f-4035fc585ecb None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:33.237960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b54dc0-adc2-4ed3-b44f-4035fc585ecb None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:33.238234 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b54dc0-adc2-4ed3-b44f-4035fc585ecb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-98adbc2b-3535-4016-a96a-9efdb39d3348 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:33.244025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:33.244884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:33.245658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:33.246256 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 123/258] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:33.248353 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adbc2b-3535-4016-a96a-9efdb39d3348 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:33.250193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b54dc0-adc2-4ed3-b44f-4035fc585ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-e8b54dc0-adc2-4ed3-b44f-4035fc585ecb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:33.260509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:33.261422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:33.262312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:33.263911 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 136/259] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:15:33.263911 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b54dc0-adc2-4ed3-b44f-4035fc585ecb None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:33.311061 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:33.382939 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b54dc0-adc2-4ed3-b44f-4035fc585ecb None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:33.396629 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adbc2b-3535-4016-a96a-9efdb39d3348 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:33.422586 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb95de0-4180-4c28-8a5d-06439a73ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:33.423231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb95de0-4180-4c28-8a5d-06439a73ee8b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:33.423518 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb95de0-4180-4c28-8a5d-06439a73ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:33.423792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb95de0-4180-4c28-8a5d-06439a73ee8b None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:33.424537 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb95de0-4180-4c28-8a5d-06439a73ee8b None admin] RBAC: Adding query filter params (name=member) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:33.424844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb95de0-4180-4c28-8a5d-06439a73ee8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:33.426256 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb95de0-4180-4c28-8a5d-06439a73ee8b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:33.435942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 137/260] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:33.436776 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb95de0-4180-4c28-8a5d-06439a73ee8b None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:33.447259 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2518fbc-c5e4-4b4a-b3af-e98ceb2ad019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:33.448176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2518fbc-c5e4-4b4a-b3af-e98ceb2ad019 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:33.448642 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2518fbc-c5e4-4b4a-b3af-e98ceb2ad019 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:33.449098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2518fbc-c5e4-4b4a-b3af-e98ceb2ad019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:33.451405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2518fbc-c5e4-4b4a-b3af-e98ceb2ad019 None admin] RBAC: Adding query filter params (role.id=cfd002a6d7564425bfaa1379d4b2c562, scope.project.id=eab201cd44aa434290a1342e2a40c316, user.id=cd10c5504caa46d9993b14fd2c3dcb0e) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:33.452144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2518fbc-c5e4-4b4a-b3af-e98ceb2ad019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:33.454717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2518fbc-c5e4-4b4a-b3af-e98ceb2ad019 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:33.463287 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 124/261] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:33 2022] GET /identity/v3/role_assignments?user.id=cd10c5504caa46d9993b14fd2c3dcb0e&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=cfd002a6d7564425bfaa1379d4b2c562 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:33.464512 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2518fbc-c5e4-4b4a-b3af-e98ceb2ad019 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:33.487027 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:33.571576 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:33.576816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb95de0-4180-4c28-8a5d-06439a73ee8b None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:33.617793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c98d82-bd95-4a93-8e41-47b5a1b246f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:33.618898 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c98d82-bd95-4a93-8e41-47b5a1b246f1 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:33.619393 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c98d82-bd95-4a93-8e41-47b5a1b246f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:33.619874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c98d82-bd95-4a93-8e41-47b5a1b246f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:33.620897 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c98d82-bd95-4a93-8e41-47b5a1b246f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:33.621417 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c98d82-bd95-4a93-8e41-47b5a1b246f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:33.624012 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c98d82-bd95-4a93-8e41-47b5a1b246f1 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:33.640873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 138/262] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:33.642755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c98d82-bd95-4a93-8e41-47b5a1b246f1 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:33.753322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c98d82-bd95-4a93-8e41-47b5a1b246f1 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:33.765121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2518fbc-c5e4-4b4a-b3af-e98ceb2ad019 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:33.790744 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276dee1-1259-42db-8771-4cf87f843b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:33.792075 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276dee1-1259-42db-8771-4cf87f843b5a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:33.792595 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276dee1-1259-42db-8771-4cf87f843b5a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:33.793075 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276dee1-1259-42db-8771-4cf87f843b5a None admin] PATH_INFO: `/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:33.794818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276dee1-1259-42db-8771-4cf87f843b5a None admin] RBAC: Authorizing `identity:get_user(user_id=5d1b2e5bb1f542e1a563ccd34b5bb131)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:33.796645 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276dee1-1259-42db-8771-4cf87f843b5a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:33.798562 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 139/263] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:33 2022] GET /identity/v3/users/5d1b2e5bb1f542e1a563ccd34b5bb131 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:33.804400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276dee1-1259-42db-8771-4cf87f843b5a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:33.843171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:33.867369 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9b41b-697c-4c30-aa89-fe9766aa5d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:33.868325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9b41b-697c-4c30-aa89-fe9766aa5d3c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:33.868611 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9b41b-697c-4c30-aa89-fe9766aa5d3c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:33.868940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9b41b-697c-4c30-aa89-fe9766aa5d3c None admin] PATH_INFO: `/v3/users/7a464e70d07d4acaa9a51aa75084072e` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:33.873426 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9b41b-697c-4c30-aa89-fe9766aa5d3c None admin] RBAC: Authorizing `identity:get_user(user_id=7a464e70d07d4acaa9a51aa75084072e)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:33.875005 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9b41b-697c-4c30-aa89-fe9766aa5d3c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:33.876688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 125/264] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:33 2022] GET /identity/v3/users/7a464e70d07d4acaa9a51aa75084072e => generated 297 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:33.883682 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9b41b-697c-4c30-aa89-fe9766aa5d3c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:33.921609 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276dee1-1259-42db-8771-4cf87f843b5a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:33.958912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ac8c3-92af-46ef-a292-9725cc503f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:33.959641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ac8c3-92af-46ef-a292-9725cc503f38 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:33.959937 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ac8c3-92af-46ef-a292-9725cc503f38 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:33.960224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ac8c3-92af-46ef-a292-9725cc503f38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:34.045935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ac8c3-92af-46ef-a292-9725cc503f38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:34.047532 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ac8c3-92af-46ef-a292-9725cc503f38 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:34.095169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:34.158141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 140/265] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 14:15:34.164213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ac8c3-92af-46ef-a292-9725cc503f38 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:34.209265 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:34.291534 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9b41b-697c-4c30-aa89-fe9766aa5d3c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:34.311008 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ac8c3-92af-46ef-a292-9725cc503f38 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:34.350505 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:34.359943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec70a-0cb6-4a75-a0a7-b2c38738748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:34.360833 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec70a-0cb6-4a75-a0a7-b2c38738748d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:34.376761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec70a-0cb6-4a75-a0a7-b2c38738748d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:34.376761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec70a-0cb6-4a75-a0a7-b2c38738748d None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:34.376761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec70a-0cb6-4a75-a0a7-b2c38738748d None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:34.376761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec70a-0cb6-4a75-a0a7-b2c38738748d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:34.376761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 141/266] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:34 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:34.376761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec70a-0cb6-4a75-a0a7-b2c38738748d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:34.377166 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dc447-c220-44ad-8dae-0d1ac42cbbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:34.378531 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dc447-c220-44ad-8dae-0d1ac42cbbee None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:34.380093 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dc447-c220-44ad-8dae-0d1ac42cbbee None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:34.380374 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dc447-c220-44ad-8dae-0d1ac42cbbee None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:34.382545 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dc447-c220-44ad-8dae-0d1ac42cbbee None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:34.387109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dc447-c220-44ad-8dae-0d1ac42cbbee None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:34.389820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 126/267] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:33 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:34.395157 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dc447-c220-44ad-8dae-0d1ac42cbbee None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:34.498094 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec70a-0cb6-4a75-a0a7-b2c38738748d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:34.532694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1971a2-652f-46c2-9658-94bd49218b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:34.533421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1971a2-652f-46c2-9658-94bd49218b31 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:34.533702 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1971a2-652f-46c2-9658-94bd49218b31 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:34.533978 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1971a2-652f-46c2-9658-94bd49218b31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:34.534941 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1971a2-652f-46c2-9658-94bd49218b31 None admin] RBAC: Adding query filter params (role.id=5782703fc53f48f28fb7015ae693cd60, scope.project.id=eab201cd44aa434290a1342e2a40c316, user.id=5d1b2e5bb1f542e1a563ccd34b5bb131) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:34.535263 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1971a2-652f-46c2-9658-94bd49218b31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:34.536708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1971a2-652f-46c2-9658-94bd49218b31 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:34.543134 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 142/268] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:34 2022] GET /identity/v3/role_assignments?user.id=5d1b2e5bb1f542e1a563ccd34b5bb131&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=5782703fc53f48f28fb7015ae693cd60 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:34.579593 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dc447-c220-44ad-8dae-0d1ac42cbbee None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:34.642627 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452bb2c-c33c-461f-ba25-f1d5863ea112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:34.643669 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452bb2c-c33c-461f-ba25-f1d5863ea112 None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:34.643950 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452bb2c-c33c-461f-ba25-f1d5863ea112 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:34.644224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452bb2c-c33c-461f-ba25-f1d5863ea112 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316/users/7a464e70d07d4acaa9a51aa75084072e/roles/3ce491f94839419ea9ba3b84324fcd8f` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:34.646316 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452bb2c-c33c-461f-ba25-f1d5863ea112 None admin] RBAC: Authorizing `identity:create_grant(project_id=eab201cd44aa434290a1342e2a40c316, user_id=7a464e70d07d4acaa9a51aa75084072e, role_id=3ce491f94839419ea9ba3b84324fcd8f)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:34.648000 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452bb2c-c33c-461f-ba25-f1d5863ea112 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:34.726909 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 127/269] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:15:34 2022] PUT /identity/v3/projects/eab201cd44aa434290a1342e2a40c316/users/7a464e70d07d4acaa9a51aa75084072e/roles/3ce491f94839419ea9ba3b84324fcd8f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:35.596577 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482cb7d-f61e-409f-a48e-518126dec434 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:35.597617 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482cb7d-f61e-409f-a48e-518126dec434 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:35.598133 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482cb7d-f61e-409f-a48e-518126dec434 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:35.599782 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 143/270] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:35.605484 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b9ef6-c4f3-497b-8cda-02e1f3217878 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:35.606306 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b9ef6-c4f3-497b-8cda-02e1f3217878 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:35.607566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b9ef6-c4f3-497b-8cda-02e1f3217878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:35.614938 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:35.626868 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-597b9ef6-c4f3-497b-8cda-02e1f3217878 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:35.628337 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-597b9ef6-c4f3-497b-8cda-02e1f3217878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:35.699832 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 128/271] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:35.728488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482cb7d-f61e-409f-a48e-518126dec434 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:35.796133 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:35.813665 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab406446-352a-4090-b220-497270a64882 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:35.814307 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab406446-352a-4090-b220-497270a64882 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:35.814818 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab406446-352a-4090-b220-497270a64882 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:35.816633 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 129/272] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:15:35.821902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f56e7-6199-4bfd-a3a2-69e28cd3ecb4 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:35.822434 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f56e7-6199-4bfd-a3a2-69e28cd3ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:35.822952 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f56e7-6199-4bfd-a3a2-69e28cd3ecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:35.843591 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482cb7d-f61e-409f-a48e-518126dec434 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:35.843782 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-a87f56e7-6199-4bfd-a3a2-69e28cd3ecb4 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:35.845338 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-a87f56e7-6199-4bfd-a3a2-69e28cd3ecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:35.885049 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a455d-b1eb-4c13-b3e1-7b75f0fbe484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:35.885495 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a455d-b1eb-4c13-b3e1-7b75f0fbe484 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:35.885781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a455d-b1eb-4c13-b3e1-7b75f0fbe484 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:35.886060 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a455d-b1eb-4c13-b3e1-7b75f0fbe484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:35.887247 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a455d-b1eb-4c13-b3e1-7b75f0fbe484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:35.889171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a455d-b1eb-4c13-b3e1-7b75f0fbe484 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:35.893105 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 144/273] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:35.896823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697cc5e-cef5-4628-8583-b9437d47278f None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:35.897114 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697cc5e-cef5-4628-8583-b9437d47278f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:35.897394 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697cc5e-cef5-4628-8583-b9437d47278f None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:35.898745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 145/274] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:35.902887 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697cc5e-cef5-4628-8583-b9437d47278f None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:35.929397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 130/275] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:35.933180 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386a2ae-6676-4144-9636-da68d2c83be5 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:35.933765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386a2ae-6676-4144-9636-da68d2c83be5 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:35.935054 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386a2ae-6676-4144-9636-da68d2c83be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:35.957969 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-f386a2ae-6676-4144-9636-da68d2c83be5 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:35.959202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-f386a2ae-6676-4144-9636-da68d2c83be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:36.018693 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697cc5e-cef5-4628-8583-b9437d47278f None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:36.019189 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:36.027099 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 131/276] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:36.032446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386a2ae-6676-4144-9636-da68d2c83be5 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:36.052673 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:36.061571 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d333d1-dd10-437c-8c86-3dd650964eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:36.062272 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d333d1-dd10-437c-8c86-3dd650964eff None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:36.062586 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d333d1-dd10-437c-8c86-3dd650964eff None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:36.062882 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d333d1-dd10-437c-8c86-3dd650964eff None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:36.063704 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d333d1-dd10-437c-8c86-3dd650964eff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:36.065103 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d333d1-dd10-437c-8c86-3dd650964eff None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:36.141991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386a2ae-6676-4144-9636-da68d2c83be5 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:36.176730 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 146/277] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:15:35 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:15:36.177757 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d333d1-dd10-437c-8c86-3dd650964eff None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:36.183213 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ce50-b4d2-4820-bb4f-3c385722e295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:36.184075 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ce50-b4d2-4820-bb4f-3c385722e295 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:36.184406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ce50-b4d2-4820-bb4f-3c385722e295 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:36.185113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ce50-b4d2-4820-bb4f-3c385722e295 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:36.202831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ce50-b4d2-4820-bb4f-3c385722e295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-2311ce50-b4d2-4820-bb4f-3c385722e295 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:36.213494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:36.214524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:36.215734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 132/278] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:36.221426 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ce50-b4d2-4820-bb4f-3c385722e295 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:36.289585 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:36.307190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d333d1-dd10-437c-8c86-3dd650964eff None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:36.353139 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ce50-b4d2-4820-bb4f-3c385722e295 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:36.358276 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b931a7-087f-4a38-8829-9f6635615850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:36.359445 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b931a7-087f-4a38-8829-9f6635615850 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:36.359972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b931a7-087f-4a38-8829-9f6635615850 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:36.360475 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b931a7-087f-4a38-8829-9f6635615850 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:36.377651 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b931a7-087f-4a38-8829-9f6635615850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-e4b931a7-087f-4a38-8829-9f6635615850 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:36.386432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:36.387347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:36.389286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 147/279] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:36.394545 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b931a7-087f-4a38-8829-9f6635615850 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:36.402443 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c9824-9618-4ea7-8dfd-51e587a29303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:36.403158 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c9824-9618-4ea7-8dfd-51e587a29303 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:36.404109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c9824-9618-4ea7-8dfd-51e587a29303 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:36.404364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c9824-9618-4ea7-8dfd-51e587a29303 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:36.405174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c9824-9618-4ea7-8dfd-51e587a29303 None admin] RBAC: Adding query filter params (name=member) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:36.405480 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c9824-9618-4ea7-8dfd-51e587a29303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:36.407722 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c9824-9618-4ea7-8dfd-51e587a29303 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:36.416684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 133/280] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:36.424500 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c9824-9618-4ea7-8dfd-51e587a29303 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:36.456282 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:36.526927 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b931a7-087f-4a38-8829-9f6635615850 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:36.558166 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c9824-9618-4ea7-8dfd-51e587a29303 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:36.573401 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d71915-6aaa-44c4-843a-f5968a7171dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:36.574102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d71915-6aaa-44c4-843a-f5968a7171dd None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:36.574469 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d71915-6aaa-44c4-843a-f5968a7171dd None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:36.574821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d71915-6aaa-44c4-843a-f5968a7171dd None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:36.576133 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d71915-6aaa-44c4-843a-f5968a7171dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:36.576447 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d71915-6aaa-44c4-843a-f5968a7171dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:36.578495 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d71915-6aaa-44c4-843a-f5968a7171dd None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:36.578629 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:36.590445 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 148/281] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:36.597077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d71915-6aaa-44c4-843a-f5968a7171dd None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:36.601118 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31181914-f1bc-474f-9a31-1a43c1384a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:36.602170 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31181914-f1bc-474f-9a31-1a43c1384a52 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:36.602717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31181914-f1bc-474f-9a31-1a43c1384a52 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:36.603209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31181914-f1bc-474f-9a31-1a43c1384a52 None admin] PATH_INFO: `/v3/users/fcebd7a39fd14cd7a14d13c152739e81` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:36.623601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31181914-f1bc-474f-9a31-1a43c1384a52 None admin] RBAC: Authorizing `identity:get_user(user_id=fcebd7a39fd14cd7a14d13c152739e81)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:36.625935 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31181914-f1bc-474f-9a31-1a43c1384a52 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:36.628980 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 134/282] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:36 2022] GET /identity/v3/users/fcebd7a39fd14cd7a14d13c152739e81 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:36.634048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31181914-f1bc-474f-9a31-1a43c1384a52 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:36.731581 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d71915-6aaa-44c4-843a-f5968a7171dd None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:36.749089 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:36.757567 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31181914-f1bc-474f-9a31-1a43c1384a52 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:36.796345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cf859-a75b-4b8b-9840-5ee0f1d02e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:36.797431 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cf859-a75b-4b8b-9840-5ee0f1d02e8a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:36.797726 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cf859-a75b-4b8b-9840-5ee0f1d02e8a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:36.798004 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cf859-a75b-4b8b-9840-5ee0f1d02e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:36.798876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cf859-a75b-4b8b-9840-5ee0f1d02e8a None admin] RBAC: Adding query filter params (role.id=3ce491f94839419ea9ba3b84324fcd8f, user.id=fcebd7a39fd14cd7a14d13c152739e81, scope.system=all) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:36.799192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cf859-a75b-4b8b-9840-5ee0f1d02e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:36.800646 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cf859-a75b-4b8b-9840-5ee0f1d02e8a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:36.806538 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 135/283] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 2 14:15:36 2022] GET /identity/v3/role_assignments?user.id=fcebd7a39fd14cd7a14d13c152739e81&scope.system=all&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:36.819665 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ccca1-0677-4ccf-9d70-212e5859d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:36.820591 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ccca1-0677-4ccf-9d70-212e5859d082 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:36.820874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ccca1-0677-4ccf-9d70-212e5859d082 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:36.821149 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ccca1-0677-4ccf-9d70-212e5859d082 None admin] PATH_INFO: `/v3/users/cd10c5504caa46d9993b14fd2c3dcb0e` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:36.822530 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ccca1-0677-4ccf-9d70-212e5859d082 None admin] RBAC: Authorizing `identity:get_user(user_id=cd10c5504caa46d9993b14fd2c3dcb0e)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:36.824093 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ccca1-0677-4ccf-9d70-212e5859d082 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:36.826307 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 149/284] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:36 2022] GET /identity/v3/users/cd10c5504caa46d9993b14fd2c3dcb0e => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:36.832015 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cf859-a75b-4b8b-9840-5ee0f1d02e8a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:36.910759 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:37.000545 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cf859-a75b-4b8b-9840-5ee0f1d02e8a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:37.051478 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cbc4f-9b2c-46db-8656-8242da3e4aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:37.052371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cbc4f-9b2c-46db-8656-8242da3e4aea None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:37.052823 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cbc4f-9b2c-46db-8656-8242da3e4aea None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:37.053109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cbc4f-9b2c-46db-8656-8242da3e4aea None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:37.054433 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cbc4f-9b2c-46db-8656-8242da3e4aea None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:37.055936 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cbc4f-9b2c-46db-8656-8242da3e4aea None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:37.058013 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 136/285] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:36 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:37.063417 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ccca1-0677-4ccf-9d70-212e5859d082 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:37.190612 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ccca1-0677-4ccf-9d70-212e5859d082 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:37.219842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c15c4-a6f4-4028-a399-af82272f6f6f None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:37.220198 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c15c4-a6f4-4028-a399-af82272f6f6f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:37.220382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c15c4-a6f4-4028-a399-af82272f6f6f None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:37.222045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 137/286] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:37.235591 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9948-f600-490e-b7f9-ced3fc5412ad None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:37.235992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9948-f600-490e-b7f9-ced3fc5412ad None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:37.236275 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9948-f600-490e-b7f9-ced3fc5412ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:37.236472 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d04e3-10bd-4ddb-9af3-a355cf3602fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:37.237405 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d04e3-10bd-4ddb-9af3-a355cf3602fd None admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:37.237692 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d04e3-10bd-4ddb-9af3-a355cf3602fd None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:37.237974 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d04e3-10bd-4ddb-9af3-a355cf3602fd None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316/users/cd10c5504caa46d9993b14fd2c3dcb0e/roles/cfd002a6d7564425bfaa1379d4b2c562` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:37.245427 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d04e3-10bd-4ddb-9af3-a355cf3602fd None admin] RBAC: Authorizing `identity:create_grant(project_id=eab201cd44aa434290a1342e2a40c316, user_id=cd10c5504caa46d9993b14fd2c3dcb0e, role_id=cfd002a6d7564425bfaa1379d4b2c562)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:37.246908 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d04e3-10bd-4ddb-9af3-a355cf3602fd None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:37.281116 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-b55c9948-f600-490e-b7f9-ced3fc5412ad None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:37.281116 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-b55c9948-f600-490e-b7f9-ced3fc5412ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:37.345628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 138/287] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:37.365030 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 150/288] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:15:37 2022] PUT /identity/v3/projects/eab201cd44aa434290a1342e2a40c316/users/cd10c5504caa46d9993b14fd2c3dcb0e/roles/cfd002a6d7564425bfaa1379d4b2c562 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:37.383471 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c9948-f600-490e-b7f9-ced3fc5412ad None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:37.428615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:37.520790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c9948-f600-490e-b7f9-ced3fc5412ad None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:37.569278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922437d-056b-4bae-bcb4-c927b3e63ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:37.570227 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922437d-056b-4bae-bcb4-c927b3e63ad4 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:37.570558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922437d-056b-4bae-bcb4-c927b3e63ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:37.570864 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922437d-056b-4bae-bcb4-c927b3e63ad4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:37.586793 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922437d-056b-4bae-bcb4-c927b3e63ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-4922437d-056b-4bae-bcb4-c927b3e63ad4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:37.595329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:37.596289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:37.597149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:37.599691 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 139/289] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:37.608619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d04e3-10bd-4ddb-9af3-a355cf3602fd None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:37.673525 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:37.760336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d04e3-10bd-4ddb-9af3-a355cf3602fd None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:37.799092 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4af2b6-9504-4f71-a070-62c80c9b1afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:37.799876 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4af2b6-9504-4f71-a070-62c80c9b1afe None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:37.800173 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4af2b6-9504-4f71-a070-62c80c9b1afe None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:37.800465 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4af2b6-9504-4f71-a070-62c80c9b1afe None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:37.801256 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4af2b6-9504-4f71-a070-62c80c9b1afe None admin] RBAC: Adding query filter params (name=member) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:37.801577 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4af2b6-9504-4f71-a070-62c80c9b1afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:37.803079 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4af2b6-9504-4f71-a070-62c80c9b1afe None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:37.813487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 151/290] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:37.819166 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922437d-056b-4bae-bcb4-c927b3e63ad4 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:37.957870 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:37.964791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922437d-056b-4bae-bcb4-c927b3e63ad4 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:38.016002 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad25ae-9e04-4047-93f0-e7c89d1c6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:38.016885 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad25ae-9e04-4047-93f0-e7c89d1c6376 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:38.017228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad25ae-9e04-4047-93f0-e7c89d1c6376 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:38.017510 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad25ae-9e04-4047-93f0-e7c89d1c6376 None admin] PATH_INFO: `/v3/users/7a464e70d07d4acaa9a51aa75084072e` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:38.021494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad25ae-9e04-4047-93f0-e7c89d1c6376 None admin] RBAC: Authorizing `identity:get_user(user_id=7a464e70d07d4acaa9a51aa75084072e)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:38.023001 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad25ae-9e04-4047-93f0-e7c89d1c6376 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:38.024968 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 140/291] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:37 2022] GET /identity/v3/users/7a464e70d07d4acaa9a51aa75084072e => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:38.031425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4af2b6-9504-4f71-a070-62c80c9b1afe None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:38.167112 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:38.172717 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4af2b6-9504-4f71-a070-62c80c9b1afe None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:38.219140 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106665f-5e56-417c-b6f8-74bc7dc0d464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:38.219800 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106665f-5e56-417c-b6f8-74bc7dc0d464 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:38.220088 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106665f-5e56-417c-b6f8-74bc7dc0d464 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:38.220367 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106665f-5e56-417c-b6f8-74bc7dc0d464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:38.297848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106665f-5e56-417c-b6f8-74bc7dc0d464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:38.299433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106665f-5e56-417c-b6f8-74bc7dc0d464 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:38.403992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:38.412011 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 152/292] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:38.415601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad25ae-9e04-4047-93f0-e7c89d1c6376 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:38.549780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad25ae-9e04-4047-93f0-e7c89d1c6376 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:38.601783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdcbf7-ffe5-44e1-8be2-3d0ad689f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:38.602790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdcbf7-ffe5-44e1-8be2-3d0ad689f01f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:38.603088 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdcbf7-ffe5-44e1-8be2-3d0ad689f01f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:38.605313 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdcbf7-ffe5-44e1-8be2-3d0ad689f01f None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:38.605313 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdcbf7-ffe5-44e1-8be2-3d0ad689f01f None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:38.606134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdcbf7-ffe5-44e1-8be2-3d0ad689f01f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:38.608972 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 141/293] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:38 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:38.614631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106665f-5e56-417c-b6f8-74bc7dc0d464 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:38.736711 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106665f-5e56-417c-b6f8-74bc7dc0d464 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:38.775340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db7c8a-3e4c-417d-a160-51bd1a47d20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:38.776035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7c8a-3e4c-417d-a160-51bd1a47d20a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:38.776321 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7c8a-3e4c-417d-a160-51bd1a47d20a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:38.776600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7c8a-3e4c-417d-a160-51bd1a47d20a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:38.777480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db7c8a-3e4c-417d-a160-51bd1a47d20a None admin] RBAC: Adding query filter params (role.id=3ce491f94839419ea9ba3b84324fcd8f, scope.project.id=eab201cd44aa434290a1342e2a40c316, user.id=7a464e70d07d4acaa9a51aa75084072e) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:38.777841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db7c8a-3e4c-417d-a160-51bd1a47d20a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:38.780421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db7c8a-3e4c-417d-a160-51bd1a47d20a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:38.787958 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 153/294] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:38 2022] GET /identity/v3/role_assignments?user.id=7a464e70d07d4acaa9a51aa75084072e&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:39.166988 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba810-5543-4e77-960b-bc9357a82dc3 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.167980 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba810-5543-4e77-960b-bc9357a82dc3 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.168533 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba810-5543-4e77-960b-bc9357a82dc3 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.171013 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 142/295] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:39.176264 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199327-3a11-4cbb-9849-ddaa3893f233 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.176560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199327-3a11-4cbb-9849-ddaa3893f233 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.176839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199327-3a11-4cbb-9849-ddaa3893f233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.198763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-4d199327-3a11-4cbb-9849-ddaa3893f233 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:39.199979 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-4d199327-3a11-4cbb-9849-ddaa3893f233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:39.276894 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:39.289132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 154/296] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:39.314378 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ba810-5543-4e77-960b-bc9357a82dc3 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:39.356166 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:39.409676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ff229-b34c-4578-8ba5-2d7229722c2e None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.410033 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ff229-b34c-4578-8ba5-2d7229722c2e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.410242 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ff229-b34c-4578-8ba5-2d7229722c2e None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.411918 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 155/297] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:39.417644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e200b-960e-40d6-9033-a3cc35f4893a None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.417914 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e200b-960e-40d6-9033-a3cc35f4893a None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.418140 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e200b-960e-40d6-9033-a3cc35f4893a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.436404 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-2d7e200b-960e-40d6-9033-a3cc35f4893a None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:39.437603 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-2d7e200b-960e-40d6-9033-a3cc35f4893a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:39.458917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ba810-5543-4e77-960b-bc9357a82dc3 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:39.497894 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e72a5-ce98-4778-967c-4830ec889c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:39.498808 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e72a5-ce98-4778-967c-4830ec889c7c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.499033 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e72a5-ce98-4778-967c-4830ec889c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.499313 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e72a5-ce98-4778-967c-4830ec889c7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.510827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e72a5-ce98-4778-967c-4830ec889c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:39.513811 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 156/298] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-a50e72a5-ce98-4778-967c-4830ec889c7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:39.525035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:39.526007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:39.527250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:39.530364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 143/299] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:39.538672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e200b-960e-40d6-9033-a3cc35f4893a None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:39.539249 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e72a5-ce98-4778-967c-4830ec889c7c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:39.654589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e200b-960e-40d6-9033-a3cc35f4893a None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:39.661096 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:39.678099 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e72a5-ce98-4778-967c-4830ec889c7c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:39.678347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:39.693021 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d21e3-27b3-4e41-8b7b-83a59f791536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:39.694035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d21e3-27b3-4e41-8b7b-83a59f791536 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.694526 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d21e3-27b3-4e41-8b7b-83a59f791536 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.695089 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d21e3-27b3-4e41-8b7b-83a59f791536 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.696189 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d21e3-27b3-4e41-8b7b-83a59f791536 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:39.696704 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d21e3-27b3-4e41-8b7b-83a59f791536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:39.698291 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d21e3-27b3-4e41-8b7b-83a59f791536 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:39.709879 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 157/300] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:39.718697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d21e3-27b3-4e41-8b7b-83a59f791536 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:39.722157 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78346e-9e6f-4c6b-97e0-5dc1014da751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:39.723566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78346e-9e6f-4c6b-97e0-5dc1014da751 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.723566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78346e-9e6f-4c6b-97e0-5dc1014da751 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.723772 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78346e-9e6f-4c6b-97e0-5dc1014da751 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.725041 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78346e-9e6f-4c6b-97e0-5dc1014da751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:39.726618 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78346e-9e6f-4c6b-97e0-5dc1014da751 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:39.728708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 144/301] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:15:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:39.734750 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78346e-9e6f-4c6b-97e0-5dc1014da751 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:39.833032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d21e3-27b3-4e41-8b7b-83a59f791536 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:39.840112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78346e-9e6f-4c6b-97e0-5dc1014da751 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:39.869212 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a79b74-bea0-4596-b8cc-6588077c0a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:39.870331 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a79b74-bea0-4596-b8cc-6588077c0a3f None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.870609 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a79b74-bea0-4596-b8cc-6588077c0a3f None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.870912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a79b74-bea0-4596-b8cc-6588077c0a3f None admin] PATH_INFO: `/v3/users/6fee4e6f6c13441382b164fe79bd8c11` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.878447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b3ff7-a755-406f-befc-ef3971380074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:39.883246 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b3ff7-a755-406f-befc-ef3971380074 None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.883537 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b3ff7-a755-406f-befc-ef3971380074 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.883816 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b3ff7-a755-406f-befc-ef3971380074 None admin] PATH_INFO: `/v3/groups` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.884513 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b3ff7-a755-406f-befc-ef3971380074 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:39.885967 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b3ff7-a755-406f-befc-ef3971380074 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:39.894096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a79b74-bea0-4596-b8cc-6588077c0a3f None admin] RBAC: Authorizing `identity:get_user(user_id=6fee4e6f6c13441382b164fe79bd8c11)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:39.895643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a79b74-bea0-4596-b8cc-6588077c0a3f None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:39.897386 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 158/302] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:39 2022] GET /identity/v3/users/6fee4e6f6c13441382b164fe79bd8c11 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:39.898665 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0068e2-346a-4d5e-acb5-13bfa2983446 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.898962 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0068e2-346a-4d5e-acb5-13bfa2983446 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.899242 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0068e2-346a-4d5e-acb5-13bfa2983446 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.900450 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 159/303] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:39.903110 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0068e2-346a-4d5e-acb5-13bfa2983446 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:39.946595 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:39.962340 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 145/304] 10.222.0.59 () {60 vars in 1134 bytes} [Thu Jun 2 14:15:39 2022] POST /identity/v3/groups => generated 229 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:15:39.970923 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5d3a-fe94-4854-b196-8d7f04340223 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:39.970923 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5d3a-fe94-4854-b196-8d7f04340223 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:39.970923 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5d3a-fe94-4854-b196-8d7f04340223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:39.996141 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-00db5d3a-fe94-4854-b196-8d7f04340223 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:39.999069 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-00db5d3a-fe94-4854-b196-8d7f04340223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:40.013344 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0068e2-346a-4d5e-acb5-13bfa2983446 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:40.022761 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:40.055222 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8315e-9223-4d34-8afd-fe42b5d9f5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:40.055942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8315e-9223-4d34-8afd-fe42b5d9f5d3 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:40.056235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8315e-9223-4d34-8afd-fe42b5d9f5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:40.056510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8315e-9223-4d34-8afd-fe42b5d9f5d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:40.057368 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8315e-9223-4d34-8afd-fe42b5d9f5d3 None admin] RBAC: Adding query filter params (role.id=cfd002a6d7564425bfaa1379d4b2c562, user.id=6fee4e6f6c13441382b164fe79bd8c11, scope.system=all) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:40.057739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8315e-9223-4d34-8afd-fe42b5d9f5d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:40.059269 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8315e-9223-4d34-8afd-fe42b5d9f5d3 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:40.066549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 160/305] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 2 14:15:39 2022] GET /identity/v3/role_assignments?user.id=6fee4e6f6c13441382b164fe79bd8c11&scope.system=all&role.id=cfd002a6d7564425bfaa1379d4b2c562 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:40.101985 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 146/306] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:40.127639 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8315e-9223-4d34-8afd-fe42b5d9f5d3 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:40.257406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8315e-9223-4d34-8afd-fe42b5d9f5d3 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:40.260179 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:40.297103 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea9078-6bff-4619-8778-eb69a9c45080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:40.297918 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9078-6bff-4619-8778-eb69a9c45080 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:40.298205 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9078-6bff-4619-8778-eb69a9c45080 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:40.298483 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea9078-6bff-4619-8778-eb69a9c45080 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:40.310292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea9078-6bff-4619-8778-eb69a9c45080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-abea9078-6bff-4619-8778-eb69a9c45080 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:40.318631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:40.319619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:40.320403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 161/307] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:40.327121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db5d3a-fe94-4854-b196-8d7f04340223 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:40.444833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db5d3a-fe94-4854-b196-8d7f04340223 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:40.483065 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d8c5-c756-456f-841d-b05a29e7ed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:40.483751 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d8c5-c756-456f-841d-b05a29e7ed95 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:40.484034 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d8c5-c756-456f-841d-b05a29e7ed95 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:40.484311 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d8c5-c756-456f-841d-b05a29e7ed95 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:40.485088 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772d8c5-c756-456f-841d-b05a29e7ed95 None admin] RBAC: Adding query filter params (name=member) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:40.485453 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772d8c5-c756-456f-841d-b05a29e7ed95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:40.487056 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772d8c5-c756-456f-841d-b05a29e7ed95 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:40.496847 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 147/308] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:40.502949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea9078-6bff-4619-8778-eb69a9c45080 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:40.622083 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea9078-6bff-4619-8778-eb69a9c45080 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:40.667676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1ba5-b88a-42a8-ad99-945801670674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:40.668565 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1ba5-b88a-42a8-ad99-945801670674 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:40.669073 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1ba5-b88a-42a8-ad99-945801670674 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:40.669374 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1ba5-b88a-42a8-ad99-945801670674 None admin] PATH_INFO: `/v3/users/fcebd7a39fd14cd7a14d13c152739e81` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:40.670679 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1ba5-b88a-42a8-ad99-945801670674 None admin] RBAC: Authorizing `identity:get_user(user_id=fcebd7a39fd14cd7a14d13c152739e81)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:40.672192 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1ba5-b88a-42a8-ad99-945801670674 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:40.674170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 162/309] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:40 2022] GET /identity/v3/users/fcebd7a39fd14cd7a14d13c152739e81 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:40.679489 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d8c5-c756-456f-841d-b05a29e7ed95 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:40.708550 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:40.732738 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03df97-3269-485d-91d6-2b50f6cff104 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:40.733029 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03df97-3269-485d-91d6-2b50f6cff104 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:40.733309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03df97-3269-485d-91d6-2b50f6cff104 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:40.738332 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 163/310] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:15:40.740953 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d32f65-a660-4151-841f-6b0144228ff0 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:40.741253 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d32f65-a660-4151-841f-6b0144228ff0 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:40.741539 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d32f65-a660-4151-841f-6b0144228ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:40.761196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-b1d32f65-a660-4151-841f-6b0144228ff0 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:40.763800 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-b1d32f65-a660-4151-841f-6b0144228ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:40.797120 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:40.803161 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d8c5-c756-456f-841d-b05a29e7ed95 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:40.850807 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 164/311] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:40.854113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43234b8f-ede1-4acb-ba04-f573b2fcc7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:40.855023 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43234b8f-ede1-4acb-ba04-f573b2fcc7ff None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:40.855308 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43234b8f-ede1-4acb-ba04-f573b2fcc7ff None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:40.858682 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43234b8f-ede1-4acb-ba04-f573b2fcc7ff None admin] PATH_INFO: `/v3/system/users/fcebd7a39fd14cd7a14d13c152739e81/roles/3ce491f94839419ea9ba3b84324fcd8f` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:40.858682 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43234b8f-ede1-4acb-ba04-f573b2fcc7ff None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fcebd7a39fd14cd7a14d13c152739e81, role_id=3ce491f94839419ea9ba3b84324fcd8f)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:40.859247 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43234b8f-ede1-4acb-ba04-f573b2fcc7ff None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:40.878765 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d32f65-a660-4151-841f-6b0144228ff0 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:40.947258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 148/312] 10.222.0.59 () {58 vars in 1334 bytes} [Thu Jun 2 14:15:40 2022] PUT /identity/v3/system/users/fcebd7a39fd14cd7a14d13c152739e81/roles/3ce491f94839419ea9ba3b84324fcd8f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:41.012049 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d32f65-a660-4151-841f-6b0144228ff0 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:41.066315 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59df98-78c1-4cb1-92be-186dc85bc9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:41.067658 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59df98-78c1-4cb1-92be-186dc85bc9e7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:41.068145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59df98-78c1-4cb1-92be-186dc85bc9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:41.068634 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59df98-78c1-4cb1-92be-186dc85bc9e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:41.082425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59df98-78c1-4cb1-92be-186dc85bc9e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-ab59df98-78c1-4cb1-92be-186dc85bc9e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:41.092022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:41.093590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:41.094425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:41.097428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 165/313] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:15:41.108206 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43234b8f-ede1-4acb-ba04-f573b2fcc7ff None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:41.218900 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:41.246739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43234b8f-ede1-4acb-ba04-f573b2fcc7ff None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:41.286027 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cd9a8-dedc-4cc7-927e-75dda86f92ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:41.288196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd9a8-dedc-4cc7-927e-75dda86f92ab None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:41.288688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd9a8-dedc-4cc7-927e-75dda86f92ab None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:41.289170 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd9a8-dedc-4cc7-927e-75dda86f92ab None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:41.290168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cd9a8-dedc-4cc7-927e-75dda86f92ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:41.290747 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cd9a8-dedc-4cc7-927e-75dda86f92ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:41.292350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cd9a8-dedc-4cc7-927e-75dda86f92ab None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:41.302066 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 149/314] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:41.307165 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59df98-78c1-4cb1-92be-186dc85bc9e7 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:41.336664 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:41.421791 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59df98-78c1-4cb1-92be-186dc85bc9e7 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:41.459576 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db898fac-861e-4154-b963-33bc5d0f7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:41.460462 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898fac-861e-4154-b963-33bc5d0f7235 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:41.460745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898fac-861e-4154-b963-33bc5d0f7235 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:41.461018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898fac-861e-4154-b963-33bc5d0f7235 None admin] PATH_INFO: `/v3/users/cd10c5504caa46d9993b14fd2c3dcb0e` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:41.462239 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db898fac-861e-4154-b963-33bc5d0f7235 None admin] RBAC: Authorizing `identity:get_user(user_id=cd10c5504caa46d9993b14fd2c3dcb0e)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:41.463727 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db898fac-861e-4154-b963-33bc5d0f7235 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:41.466397 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 166/315] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:41 2022] GET /identity/v3/users/cd10c5504caa46d9993b14fd2c3dcb0e => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:41.472088 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cd9a8-dedc-4cc7-927e-75dda86f92ab None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:41.582317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cd9a8-dedc-4cc7-927e-75dda86f92ab None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:41.617894 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a9657-e94b-40d8-9f48-c1f0a2f68957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:41.618553 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a9657-e94b-40d8-9f48-c1f0a2f68957 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:41.618868 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a9657-e94b-40d8-9f48-c1f0a2f68957 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:41.619146 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a9657-e94b-40d8-9f48-c1f0a2f68957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:41.628936 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:41.695245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a9657-e94b-40d8-9f48-c1f0a2f68957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:41.696733 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a9657-e94b-40d8-9f48-c1f0a2f68957 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:41.803146 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 150/316] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:41.808247 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db898fac-861e-4154-b963-33bc5d0f7235 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:41.926221 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db898fac-861e-4154-b963-33bc5d0f7235 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:41.927965 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:41.962200 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d59b3d-30dc-434c-8592-4e6bfa8c1f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:41.963634 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59b3d-30dc-434c-8592-4e6bfa8c1f07 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:41.964514 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59b3d-30dc-434c-8592-4e6bfa8c1f07 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:41.964794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59b3d-30dc-434c-8592-4e6bfa8c1f07 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:41.966588 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d59b3d-30dc-434c-8592-4e6bfa8c1f07 None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:41.968146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d59b3d-30dc-434c-8592-4e6bfa8c1f07 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:41.970165 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 167/317] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:41 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:41.975888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a9657-e94b-40d8-9f48-c1f0a2f68957 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:42.017732 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:42.086271 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a9657-e94b-40d8-9f48-c1f0a2f68957 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:42.122773 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27692c-42e8-4444-9d4c-b8570971211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:42.123451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27692c-42e8-4444-9d4c-b8570971211d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:42.123735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27692c-42e8-4444-9d4c-b8570971211d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:42.124012 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27692c-42e8-4444-9d4c-b8570971211d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:42.124920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27692c-42e8-4444-9d4c-b8570971211d None admin] RBAC: Adding query filter params (role.id=cfd002a6d7564425bfaa1379d4b2c562, scope.project.id=eab201cd44aa434290a1342e2a40c316, user.id=cd10c5504caa46d9993b14fd2c3dcb0e) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:42.125236 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27692c-42e8-4444-9d4c-b8570971211d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:42.126783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27692c-42e8-4444-9d4c-b8570971211d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:42.133698 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 151/318] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:15:41 2022] GET /identity/v3/role_assignments?user.id=cd10c5504caa46d9993b14fd2c3dcb0e&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=cfd002a6d7564425bfaa1379d4b2c562 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:42.645204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2168044-1ffa-4802-b657-42f46bbe9bb5 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:42.645881 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2168044-1ffa-4802-b657-42f46bbe9bb5 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:42.646385 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2168044-1ffa-4802-b657-42f46bbe9bb5 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:42.648021 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 168/319] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:42.654186 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62719c4e-1cf6-4d3f-915b-1b04baddac15 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:42.654621 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62719c4e-1cf6-4d3f-915b-1b04baddac15 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:42.654836 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62719c4e-1cf6-4d3f-915b-1b04baddac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:42.673973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-62719c4e-1cf6-4d3f-915b-1b04baddac15 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:42.675280 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-62719c4e-1cf6-4d3f-915b-1b04baddac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:42.699689 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d39fa-9788-439d-9450-1ce2c65d61cc None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:42.700025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d39fa-9788-439d-9450-1ce2c65d61cc None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:42.700665 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d39fa-9788-439d-9450-1ce2c65d61cc None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:42.702088 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 169/320] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:42.706996 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed02b3e-1922-4ec6-9346-161714a49d12 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:42.707289 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed02b3e-1922-4ec6-9346-161714a49d12 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:42.707574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed02b3e-1922-4ec6-9346-161714a49d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:42.725516 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-2ed02b3e-1922-4ec6-9346-161714a49d12 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:42.726777 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-2ed02b3e-1922-4ec6-9346-161714a49d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:42.748571 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 152/321] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:42.773426 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62719c4e-1cf6-4d3f-915b-1b04baddac15 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:42.805944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:42.806139 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 170/322] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:42.829734 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed02b3e-1922-4ec6-9346-161714a49d12 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:42.891210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62719c4e-1cf6-4d3f-915b-1b04baddac15 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:42.930401 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:42.936920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50004b6-593a-4391-9b48-cc1ed13b2302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:42.937720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50004b6-593a-4391-9b48-cc1ed13b2302 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:42.938003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50004b6-593a-4391-9b48-cc1ed13b2302 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:42.939585 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50004b6-593a-4391-9b48-cc1ed13b2302 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:42.939585 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50004b6-593a-4391-9b48-cc1ed13b2302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:42.941126 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50004b6-593a-4391-9b48-cc1ed13b2302 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:42.946689 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 153/323] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:15:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:42.946828 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed02b3e-1922-4ec6-9346-161714a49d12 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:42.948518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50004b6-593a-4391-9b48-cc1ed13b2302 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:42.987272 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ff637-b27d-43ba-ba6c-e7623f2a71e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:42.988094 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ff637-b27d-43ba-ba6c-e7623f2a71e9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:42.988377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ff637-b27d-43ba-ba6c-e7623f2a71e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:42.988656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ff637-b27d-43ba-ba6c-e7623f2a71e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:43.002578 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ff637-b27d-43ba-ba6c-e7623f2a71e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-317ff637-b27d-43ba-ba6c-e7623f2a71e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:43.014045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:43.014932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:43.015871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 171/324] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:15:43.020959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ff637-b27d-43ba-ba6c-e7623f2a71e9 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:43.061978 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:43.065664 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50004b6-593a-4391-9b48-cc1ed13b2302 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:43.100458 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bd3ce-c8a0-4af8-8727-0ce60accc657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:43.101231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bd3ce-c8a0-4af8-8727-0ce60accc657 None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:43.101594 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bd3ce-c8a0-4af8-8727-0ce60accc657 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:43.101885 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bd3ce-c8a0-4af8-8727-0ce60accc657 None admin] PATH_INFO: `/v3/groups` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:43.102582 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bd3ce-c8a0-4af8-8727-0ce60accc657 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:43.104288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bd3ce-c8a0-4af8-8727-0ce60accc657 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:43.128052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ff637-b27d-43ba-ba6c-e7623f2a71e9 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:43.164659 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072b985-e9de-45ce-b9cd-8f3bee95e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:43.165326 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072b985-e9de-45ce-b9cd-8f3bee95e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:43.165612 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072b985-e9de-45ce-b9cd-8f3bee95e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:43.165885 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072b985-e9de-45ce-b9cd-8f3bee95e1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:43.166629 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072b985-e9de-45ce-b9cd-8f3bee95e1f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:43.166967 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072b985-e9de-45ce-b9cd-8f3bee95e1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:43.168349 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072b985-e9de-45ce-b9cd-8f3bee95e1f4 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:43.177009 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 172/325] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:43.182671 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072b985-e9de-45ce-b9cd-8f3bee95e1f4 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:43.194748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:43.268797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 154/326] 10.222.0.59 () {60 vars in 1134 bytes} [Thu Jun 2 14:15:42 2022] POST /identity/v3/groups => generated 226 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:15:43.282200 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072b985-e9de-45ce-b9cd-8f3bee95e1f4 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:43.321031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763ba3e-5343-4a10-a9f9-e2a7a592563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:43.321914 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ba3e-5343-4a10-a9f9-e2a7a592563e None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:43.322199 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ba3e-5343-4a10-a9f9-e2a7a592563e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:43.322474 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ba3e-5343-4a10-a9f9-e2a7a592563e None admin] PATH_INFO: `/v3/users/6fee4e6f6c13441382b164fe79bd8c11` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:43.323766 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763ba3e-5343-4a10-a9f9-e2a7a592563e None admin] RBAC: Authorizing `identity:get_user(user_id=6fee4e6f6c13441382b164fe79bd8c11)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:43.325314 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763ba3e-5343-4a10-a9f9-e2a7a592563e None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:43.327326 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 173/327] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:43 2022] GET /identity/v3/users/6fee4e6f6c13441382b164fe79bd8c11 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:43.332961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bd3ce-c8a0-4af8-8727-0ce60accc657 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:43.445429 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bd3ce-c8a0-4af8-8727-0ce60accc657 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:43.469770 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409badb-4a74-44c9-bf70-4b62f1e8be2b None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:43.470161 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409badb-4a74-44c9-bf70-4b62f1e8be2b None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:43.470504 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409badb-4a74-44c9-bf70-4b62f1e8be2b None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:43.471961 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 174/328] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:15:43.477053 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b8d6-840b-4099-a324-88e10162286b None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:43.477340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b8d6-840b-4099-a324-88e10162286b None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:43.477614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67b8d6-840b-4099-a324-88e10162286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:43.489268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a228c-29ef-4fde-ba6f-2c953bffb264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:43.490140 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a228c-29ef-4fde-ba6f-2c953bffb264 None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:43.490423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a228c-29ef-4fde-ba6f-2c953bffb264 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:43.490723 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a228c-29ef-4fde-ba6f-2c953bffb264 None admin] PATH_INFO: `/v3/system/users/6fee4e6f6c13441382b164fe79bd8c11/roles/cfd002a6d7564425bfaa1379d4b2c562` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:43.492358 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a228c-29ef-4fde-ba6f-2c953bffb264 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6fee4e6f6c13441382b164fe79bd8c11, role_id=cfd002a6d7564425bfaa1379d4b2c562)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:43.493754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a228c-29ef-4fde-ba6f-2c953bffb264 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:43.495733 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-1f67b8d6-840b-4099-a324-88e10162286b None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:43.497047 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-1f67b8d6-840b-4099-a324-88e10162286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:43.564662 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 175/329] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:43.583046 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 155/330] 10.222.0.59 () {58 vars in 1334 bytes} [Thu Jun 2 14:15:43 2022] PUT /identity/v3/system/users/6fee4e6f6c13441382b164fe79bd8c11/roles/cfd002a6d7564425bfaa1379d4b2c562 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:43.589871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67b8d6-840b-4099-a324-88e10162286b None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:43.601601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:43.716733 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67b8d6-840b-4099-a324-88e10162286b None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:43.756156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9b1f-b1cc-4245-9e54-b235ee78ca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:43.756980 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9b1f-b1cc-4245-9e54-b235ee78ca6b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:43.757261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9b1f-b1cc-4245-9e54-b235ee78ca6b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:43.757532 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9b1f-b1cc-4245-9e54-b235ee78ca6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:43.770360 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf9b1f-b1cc-4245-9e54-b235ee78ca6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-ddbf9b1f-b1cc-4245-9e54-b235ee78ca6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:43.778558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:43.779512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:43.780303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 176/331] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:43.787961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a228c-29ef-4fde-ba6f-2c953bffb264 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:43.824559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:43.911553 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a228c-29ef-4fde-ba6f-2c953bffb264 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:43.952687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1366a-c709-438d-868e-1b856bd4099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:43.953363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1366a-c709-438d-868e-1b856bd4099f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:43.953644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1366a-c709-438d-868e-1b856bd4099f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:43.953920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1366a-c709-438d-868e-1b856bd4099f None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:43.954691 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1366a-c709-438d-868e-1b856bd4099f None admin] RBAC: Adding query filter params (name=member) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:43.955056 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1366a-c709-438d-868e-1b856bd4099f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:43.956437 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1366a-c709-438d-868e-1b856bd4099f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:43.970452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 156/332] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:43.972766 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9b1f-b1cc-4245-9e54-b235ee78ca6b None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:44.046783 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:44.082879 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9b1f-b1cc-4245-9e54-b235ee78ca6b None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:44.119555 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54563fb8-c718-4133-93ba-d238e888ea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:44.120844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54563fb8-c718-4133-93ba-d238e888ea1c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:44.121231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54563fb8-c718-4133-93ba-d238e888ea1c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:44.121609 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54563fb8-c718-4133-93ba-d238e888ea1c None admin] PATH_INFO: `/v3/users/fcebd7a39fd14cd7a14d13c152739e81` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:44.123432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54563fb8-c718-4133-93ba-d238e888ea1c None admin] RBAC: Authorizing `identity:get_user(user_id=fcebd7a39fd14cd7a14d13c152739e81)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:44.124956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54563fb8-c718-4133-93ba-d238e888ea1c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:44.130745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 177/333] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:43 2022] GET /identity/v3/users/fcebd7a39fd14cd7a14d13c152739e81 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:44.133305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1366a-c709-438d-868e-1b856bd4099f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:44.240727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:44.261689 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1366a-c709-438d-868e-1b856bd4099f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:44.303121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d4ce9-b9db-40ce-adbb-4c3eac11f964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:44.303789 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4ce9-b9db-40ce-adbb-4c3eac11f964 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:44.304074 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4ce9-b9db-40ce-adbb-4c3eac11f964 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:44.304352 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4ce9-b9db-40ce-adbb-4c3eac11f964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:44.305179 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d4ce9-b9db-40ce-adbb-4c3eac11f964 None admin] RBAC: Adding query filter params (role.id=3ce491f94839419ea9ba3b84324fcd8f, user.id=fcebd7a39fd14cd7a14d13c152739e81, scope.system=all) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:44.305493 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d4ce9-b9db-40ce-adbb-4c3eac11f964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:44.307057 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d4ce9-b9db-40ce-adbb-4c3eac11f964 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:44.324071 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 157/334] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 2 14:15:44 2022] GET /identity/v3/role_assignments?user.id=fcebd7a39fd14cd7a14d13c152739e81&scope.system=all&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:46.402670 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841fac1-bc67-404a-b83c-69d053acec22 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:46.403585 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841fac1-bc67-404a-b83c-69d053acec22 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:46.404142 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841fac1-bc67-404a-b83c-69d053acec22 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:46.405949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 178/335] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:46.412796 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ee94c-dd2a-4263-a93a-85f0f24aa06a None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:46.413670 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ee94c-dd2a-4263-a93a-85f0f24aa06a None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:46.414168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ee94c-dd2a-4263-a93a-85f0f24aa06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:46.431989 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-2a3ee94c-dd2a-4263-a93a-85f0f24aa06a None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:46.433518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-2a3ee94c-dd2a-4263-a93a-85f0f24aa06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:46.507940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 158/336] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:46.534901 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841fac1-bc67-404a-b83c-69d053acec22 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:46.662837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841fac1-bc67-404a-b83c-69d053acec22 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:46.691644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1768e-2b7d-4d02-ad33-ff875551df79 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:46.692267 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1768e-2b7d-4d02-ad33-ff875551df79 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:46.692747 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1768e-2b7d-4d02-ad33-ff875551df79 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:46.694370 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 159/337] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:46.699817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510239e-a97e-4c70-960d-bef6bac3bfff None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:46.700650 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510239e-a97e-4c70-960d-bef6bac3bfff None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:46.701071 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510239e-a97e-4c70-960d-bef6bac3bfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:46.728842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef78a3-3b88-4d68-86e0-a0d90afbf20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:46.730100 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef78a3-3b88-4d68-86e0-a0d90afbf20e None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:46.730593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef78a3-3b88-4d68-86e0-a0d90afbf20e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:46.731101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef78a3-3b88-4d68-86e0-a0d90afbf20e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:46.738540 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:46.739974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-b510239e-a97e-4c70-960d-bef6bac3bfff None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:46.741315 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-b510239e-a97e-4c70-960d-bef6bac3bfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:46.748278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef78a3-3b88-4d68-86e0-a0d90afbf20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-8cef78a3-3b88-4d68-86e0-a0d90afbf20e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:46.758170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:46.760340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:46.761676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 179/338] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:46.762331 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e880206-b307-40f6-bfc7-6283b2d1a8d3 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:46.763005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e880206-b307-40f6-bfc7-6283b2d1a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:46.763280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e880206-b307-40f6-bfc7-6283b2d1a8d3 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:46.764710 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 180/339] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:15:46.769409 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e880206-b307-40f6-bfc7-6283b2d1a8d3 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:46.890181 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 160/340] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:46.893962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88802f5-66a2-4d00-b596-5af5bee3c927 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:46.894274 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88802f5-66a2-4d00-b596-5af5bee3c927 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:46.894545 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88802f5-66a2-4d00-b596-5af5bee3c927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:46.907784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:46.931315 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-f88802f5-66a2-4d00-b596-5af5bee3c927 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:46.931734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-f88802f5-66a2-4d00-b596-5af5bee3c927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:46.968187 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e880206-b307-40f6-bfc7-6283b2d1a8d3 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:47.033824 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9020-0bc2-49f8-a820-ad2ec82c7063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:47.034515 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9020-0bc2-49f8-a820-ad2ec82c7063 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:47.034835 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9020-0bc2-49f8-a820-ad2ec82c7063 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:47.035115 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9020-0bc2-49f8-a820-ad2ec82c7063 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:47.035913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc9020-0bc2-49f8-a820-ad2ec82c7063 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:47.036227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc9020-0bc2-49f8-a820-ad2ec82c7063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:47.037621 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc9020-0bc2-49f8-a820-ad2ec82c7063 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:47.058606 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 181/341] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:47.059311 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9020-0bc2-49f8-a820-ad2ec82c7063 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:47.072703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 161/342] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:47.074817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88802f5-66a2-4d00-b596-5af5bee3c927 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:47.183530 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:47.248944 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9020-0bc2-49f8-a820-ad2ec82c7063 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:47.262986 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88802f5-66a2-4d00-b596-5af5bee3c927 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:47.291663 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd549b-75d3-44d2-a786-e707dcb46d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:47.292494 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd549b-75d3-44d2-a786-e707dcb46d6d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:47.292777 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd549b-75d3-44d2-a786-e707dcb46d6d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:47.293051 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd549b-75d3-44d2-a786-e707dcb46d6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:47.310562 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd549b-75d3-44d2-a786-e707dcb46d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:47.311176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0b801-0223-4577-8513-b5dda1d3b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:47.312150 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0b801-0223-4577-8513-b5dda1d3b602 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:47.312438 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0b801-0223-4577-8513-b5dda1d3b602 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:47.312722 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0b801-0223-4577-8513-b5dda1d3b602 None admin] PATH_INFO: `/v3/users/6fee4e6f6c13441382b164fe79bd8c11` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:47.314737 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0b801-0223-4577-8513-b5dda1d3b602 None admin] RBAC: Authorizing `identity:get_user(user_id=6fee4e6f6c13441382b164fe79bd8c11)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:47.316177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0b801-0223-4577-8513-b5dda1d3b602 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:47.317872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 162/343] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Jun 2 14:15:47 2022] GET /identity/v3/users/6fee4e6f6c13441382b164fe79bd8c11 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:47.318680 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0b801-0223-4577-8513-b5dda1d3b602 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:47.321413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-aefd549b-75d3-44d2-a786-e707dcb46d6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:47.321706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:47.322593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:47.329561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 182/344] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:47.330758 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871bb9-2043-40cf-916e-57a5e0951a4b None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:47.331217 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871bb9-2043-40cf-916e-57a5e0951a4b None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:47.331648 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871bb9-2043-40cf-916e-57a5e0951a4b None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:47.335126 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 183/345] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:47.336276 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe871bb9-2043-40cf-916e-57a5e0951a4b None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:47.459053 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0b801-0223-4577-8513-b5dda1d3b602 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:47.475640 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe871bb9-2043-40cf-916e-57a5e0951a4b None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:47.498599 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:47.502228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492c3cb-f6fe-4971-85b1-d6f4006d7e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:47.503079 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492c3cb-f6fe-4971-85b1-d6f4006d7e1c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:47.503827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492c3cb-f6fe-4971-85b1-d6f4006d7e1c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:47.504115 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492c3cb-f6fe-4971-85b1-d6f4006d7e1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:47.518353 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492c3cb-f6fe-4971-85b1-d6f4006d7e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:47.519928 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530a95f-7710-4f2d-ad15-cf32d603c3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:47.520949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530a95f-7710-4f2d-ad15-cf32d603c3f9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:47.521421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530a95f-7710-4f2d-ad15-cf32d603c3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:47.521844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530a95f-7710-4f2d-ad15-cf32d603c3f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:47.522872 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530a95f-7710-4f2d-ad15-cf32d603c3f9 None admin] RBAC: Adding query filter params (role.id=cfd002a6d7564425bfaa1379d4b2c562, user.id=6fee4e6f6c13441382b164fe79bd8c11, scope.system=all) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:47.523356 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530a95f-7710-4f2d-ad15-cf32d603c3f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:47.525070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530a95f-7710-4f2d-ad15-cf32d603c3f9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-d492c3cb-f6fe-4971-85b1-d6f4006d7e1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:47.526082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:47.527326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:47.528970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 163/346] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:47.530172 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492c3cb-f6fe-4971-85b1-d6f4006d7e1c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:47.548661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 184/347] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Jun 2 14:15:47 2022] GET /identity/v3/role_assignments?user.id=6fee4e6f6c13441382b164fe79bd8c11&scope.system=all&role.id=cfd002a6d7564425bfaa1379d4b2c562 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:47.551173 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ce8bb-d176-4455-98fd-57e15d41865d None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:47.551745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ce8bb-d176-4455-98fd-57e15d41865d None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:47.552212 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ce8bb-d176-4455-98fd-57e15d41865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:47.572502 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-167ce8bb-d176-4455-98fd-57e15d41865d None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:47.575706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-167ce8bb-d176-4455-98fd-57e15d41865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:47.605613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:47.658510 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492c3cb-f6fe-4971-85b1-d6f4006d7e1c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:47.665778 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 185/348] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:47.667253 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ce8bb-d176-4455-98fd-57e15d41865d None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:47.724798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c63f5e-198c-4565-bbeb-df05df39ce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:47.725655 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c63f5e-198c-4565-bbeb-df05df39ce3d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:47.725947 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c63f5e-198c-4565-bbeb-df05df39ce3d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:47.726226 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c63f5e-198c-4565-bbeb-df05df39ce3d None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:47.727462 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c63f5e-198c-4565-bbeb-df05df39ce3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:47.727782 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c63f5e-198c-4565-bbeb-df05df39ce3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:47.729504 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c63f5e-198c-4565-bbeb-df05df39ce3d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:47.744060 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 164/349] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:47.744993 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c63f5e-198c-4565-bbeb-df05df39ce3d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:47.852867 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ce8bb-d176-4455-98fd-57e15d41865d None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:47.863368 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:47.902396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471585fa-6ef5-4da9-a85c-6ae1d23c983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:47.904940 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471585fa-6ef5-4da9-a85c-6ae1d23c983a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:47.905797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471585fa-6ef5-4da9-a85c-6ae1d23c983a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:47.906497 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471585fa-6ef5-4da9-a85c-6ae1d23c983a None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:47.908021 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471585fa-6ef5-4da9-a85c-6ae1d23c983a None admin] RBAC: Adding query filter params (name=member) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:47.908544 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471585fa-6ef5-4da9-a85c-6ae1d23c983a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:47.909994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471585fa-6ef5-4da9-a85c-6ae1d23c983a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:47.916684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c63f5e-198c-4565-bbeb-df05df39ce3d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:47.921267 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 186/350] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:47.922198 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471585fa-6ef5-4da9-a85c-6ae1d23c983a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:47.985194 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:48.000076 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b26c7e-5add-45f5-86d9-6d81e2c6a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:48.004206 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26c7e-5add-45f5-86d9-6d81e2c6a724 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.004206 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26c7e-5add-45f5-86d9-6d81e2c6a724 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.004206 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26c7e-5add-45f5-86d9-6d81e2c6a724 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.014903 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b26c7e-5add-45f5-86d9-6d81e2c6a724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-55b26c7e-5add-45f5-86d9-6d81e2c6a724 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:48.022765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:48.023671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:48.024473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 165/351] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:48.025613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b26c7e-5add-45f5-86d9-6d81e2c6a724 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:48.046791 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471585fa-6ef5-4da9-a85c-6ae1d23c983a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:48.085820 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63664070-777a-40fc-8313-d1163027fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:48.086485 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63664070-777a-40fc-8313-d1163027fc09 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.086812 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63664070-777a-40fc-8313-d1163027fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.087270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63664070-777a-40fc-8313-d1163027fc09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.127878 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:48.137141 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b26c7e-5add-45f5-86d9-6d81e2c6a724 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:48.170285 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63664070-777a-40fc-8313-d1163027fc09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:48.171865 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63664070-777a-40fc-8313-d1163027fc09 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:48.175513 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60521e4b-7dc4-4ef9-af94-5d9532b2c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:48.176177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60521e4b-7dc4-4ef9-af94-5d9532b2c991 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.176458 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60521e4b-7dc4-4ef9-af94-5d9532b2c991 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.176733 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60521e4b-7dc4-4ef9-af94-5d9532b2c991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.233993 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:48.251091 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60521e4b-7dc4-4ef9-af94-5d9532b2c991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:48.252458 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60521e4b-7dc4-4ef9-af94-5d9532b2c991 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:48.293604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 187/352] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:48.299260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63664070-777a-40fc-8313-d1163027fc09 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:48.362149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 166/353] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:48.363076 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60521e4b-7dc4-4ef9-af94-5d9532b2c991 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:48.379048 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:48.419471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63664070-777a-40fc-8313-d1163027fc09 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:48.467063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf856a60-d4aa-4593-839a-b5aab0607488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:48.467746 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf856a60-d4aa-4593-839a-b5aab0607488 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.468032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf856a60-d4aa-4593-839a-b5aab0607488 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.468305 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf856a60-d4aa-4593-839a-b5aab0607488 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.468568 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:48.469053 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf856a60-d4aa-4593-839a-b5aab0607488 None admin] RBAC: Adding query filter params (name=member) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:48.469363 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf856a60-d4aa-4593-839a-b5aab0607488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:48.470832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf856a60-d4aa-4593-839a-b5aab0607488 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:48.482693 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 188/354] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:48.482693 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf856a60-d4aa-4593-839a-b5aab0607488 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:48.490149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60521e4b-7dc4-4ef9-af94-5d9532b2c991 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:48.538820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561e7eb-2e79-43ab-9124-052435c01683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:48.539659 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e7eb-2e79-43ab-9124-052435c01683 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.539895 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e7eb-2e79-43ab-9124-052435c01683 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.540173 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e7eb-2e79-43ab-9124-052435c01683 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.546348 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561e7eb-2e79-43ab-9124-052435c01683 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:48.546348 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561e7eb-2e79-43ab-9124-052435c01683 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:48.546729 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 167/355] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:48 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:48.548936 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00bbb7-1cd2-4325-ba0c-431d83df8f6b None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.549234 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00bbb7-1cd2-4325-ba0c-431d83df8f6b None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.549511 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00bbb7-1cd2-4325-ba0c-431d83df8f6b None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.551219 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 168/356] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:48.551939 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00bbb7-1cd2-4325-ba0c-431d83df8f6b None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:48.631364 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf856a60-d4aa-4593-839a-b5aab0607488 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:48.667411 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:48.675615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48b37b-914a-40c3-a907-526ec3ffb041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:48.675615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b37b-914a-40c3-a907-526ec3ffb041 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.675615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b37b-914a-40c3-a907-526ec3ffb041 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.675615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48b37b-914a-40c3-a907-526ec3ffb041 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.676590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48b37b-914a-40c3-a907-526ec3ffb041 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:48.678089 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48b37b-914a-40c3-a907-526ec3ffb041 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:48.690927 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 189/357] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:48 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:48.690927 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48b37b-914a-40c3-a907-526ec3ffb041 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:48.703072 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00bbb7-1cd2-4325-ba0c-431d83df8f6b None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:48.749518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd343c9-1116-411c-a49b-2422e3d1fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:48.750181 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd343c9-1116-411c-a49b-2422e3d1fb7d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.750468 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd343c9-1116-411c-a49b-2422e3d1fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.750791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd343c9-1116-411c-a49b-2422e3d1fb7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.775950 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:48.813755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48b37b-914a-40c3-a907-526ec3ffb041 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:48.828670 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd343c9-1116-411c-a49b-2422e3d1fb7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:48.830159 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd343c9-1116-411c-a49b-2422e3d1fb7d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:48.858037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4bc5c-f77c-4665-a30e-83c9dbab1e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:48.859034 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4bc5c-f77c-4665-a30e-83c9dbab1e76 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.859325 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4bc5c-f77c-4665-a30e-83c9dbab1e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.859609 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4bc5c-f77c-4665-a30e-83c9dbab1e76 None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.866263 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4bc5c-f77c-4665-a30e-83c9dbab1e76 None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:48.867995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4bc5c-f77c-4665-a30e-83c9dbab1e76 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:48.870325 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 190/358] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:48 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:48.871472 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faee7f-21f7-4d27-a822-78bb2939e1b6 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.871653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faee7f-21f7-4d27-a822-78bb2939e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.872545 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faee7f-21f7-4d27-a822-78bb2939e1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.890816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-84faee7f-21f7-4d27-a822-78bb2939e1b6 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:48.892118 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-84faee7f-21f7-4d27-a822-78bb2939e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:48.961632 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:48.966667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 169/359] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:48.966667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd343c9-1116-411c-a49b-2422e3d1fb7d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:48.973065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 191/360] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:48.977603 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b5a5-4c9c-4ed8-a0b3-7b55016ccebb None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:48.977603 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b5a5-4c9c-4ed8-a0b3-7b55016ccebb None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:48.977603 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86b5a5-4c9c-4ed8-a0b3-7b55016ccebb None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:48.977603 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 192/361] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:48.977603 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86b5a5-4c9c-4ed8-a0b3-7b55016ccebb None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:49.037222 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:49.092299 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd343c9-1116-411c-a49b-2422e3d1fb7d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:49.115806 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86b5a5-4c9c-4ed8-a0b3-7b55016ccebb None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:49.136637 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fde3d-5d53-4c0a-b789-5ac1ec33c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:49.137562 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fde3d-5d53-4c0a-b789-5ac1ec33c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:49.137851 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fde3d-5d53-4c0a-b789-5ac1ec33c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:49.138130 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fde3d-5d53-4c0a-b789-5ac1ec33c1f0 None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:49.139455 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fde3d-5d53-4c0a-b789-5ac1ec33c1f0 None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:49.140932 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fde3d-5d53-4c0a-b789-5ac1ec33c1f0 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:49.143018 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 170/362] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:48 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:49.144267 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fde3d-5d53-4c0a-b789-5ac1ec33c1f0 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:49.159609 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34ee19-d898-431a-9374-e9e3048e484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:49.160276 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34ee19-d898-431a-9374-e9e3048e484b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:49.160566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34ee19-d898-431a-9374-e9e3048e484b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:49.160848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34ee19-d898-431a-9374-e9e3048e484b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:49.161694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34ee19-d898-431a-9374-e9e3048e484b None admin] RBAC: Adding query filter params (group.id=37ec2266107f467c991bdbdd77290fa6, role.id=5782703fc53f48f28fb7015ae693cd60, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:49.162013 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34ee19-d898-431a-9374-e9e3048e484b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:49.163510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34ee19-d898-431a-9374-e9e3048e484b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:49.173232 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 193/363] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 14:15:48 2022] GET /identity/v3/role_assignments?group.id=37ec2266107f467c991bdbdd77290fa6&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=5782703fc53f48f28fb7015ae693cd60 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:49.174489 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beab7f-f33c-4811-8fde-8ff4ceb42222 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:49.174814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beab7f-f33c-4811-8fde-8ff4ceb42222 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:49.175092 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beab7f-f33c-4811-8fde-8ff4ceb42222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:49.194519 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-04beab7f-f33c-4811-8fde-8ff4ceb42222 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:49.195868 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-04beab7f-f33c-4811-8fde-8ff4ceb42222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:49.279771 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:49.286147 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fde3d-5d53-4c0a-b789-5ac1ec33c1f0 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:49.307178 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 194/364] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:49.308647 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beab7f-f33c-4811-8fde-8ff4ceb42222 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:49.317917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:49.345431 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49cced-3b33-4026-9257-c75296ae1ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:49.346601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49cced-3b33-4026-9257-c75296ae1ca8 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:49.346922 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49cced-3b33-4026-9257-c75296ae1ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:49.347278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49cced-3b33-4026-9257-c75296ae1ca8 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:49.348527 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49cced-3b33-4026-9257-c75296ae1ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:49.350045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49cced-3b33-4026-9257-c75296ae1ca8 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:49.352047 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 171/365] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:49 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:49.352825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49cced-3b33-4026-9257-c75296ae1ca8 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:49.445157 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beab7f-f33c-4811-8fde-8ff4ceb42222 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:49.489652 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988b938-c3a6-4518-9ee7-0a39fbed323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:49.490493 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988b938-c3a6-4518-9ee7-0a39fbed323e None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:49.490791 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988b938-c3a6-4518-9ee7-0a39fbed323e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:49.491068 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988b938-c3a6-4518-9ee7-0a39fbed323e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:49.491406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49cced-3b33-4026-9257-c75296ae1ca8 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:49.514085 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988b938-c3a6-4518-9ee7-0a39fbed323e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-3988b938-c3a6-4518-9ee7-0a39fbed323e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:49.525633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:49.526566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:49.527373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:49.529070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 195/366] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:49.529070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988b938-c3a6-4518-9ee7-0a39fbed323e None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:49.543032 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd7cfe-e471-422b-8cb0-61b7f7ace4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:49.544320 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd7cfe-e471-422b-8cb0-61b7f7ace4d9 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:49.544605 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd7cfe-e471-422b-8cb0-61b7f7ace4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:49.544983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd7cfe-e471-422b-8cb0-61b7f7ace4d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:49.545983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd7cfe-e471-422b-8cb0-61b7f7ace4d9 None admin] RBAC: Adding query filter params (group.id=37ec2266107f467c991bdbdd77290fa6, role.id=3ce491f94839419ea9ba3b84324fcd8f, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:49.546304 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd7cfe-e471-422b-8cb0-61b7f7ace4d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:49.547887 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd7cfe-e471-422b-8cb0-61b7f7ace4d9 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:49.555398 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 172/367] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 14:15:49 2022] GET /identity/v3/role_assignments?group.id=37ec2266107f467c991bdbdd77290fa6&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:49.556036 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd7cfe-e471-422b-8cb0-61b7f7ace4d9 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:49.588842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:49.648923 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:49.667748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988b938-c3a6-4518-9ee7-0a39fbed323e None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:49.712757 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd7cfe-e471-422b-8cb0-61b7f7ace4d9 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:49.717757 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f349af-d4bf-49e3-846b-2e03fa8bb4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:49.718656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f349af-d4bf-49e3-846b-2e03fa8bb4ea None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:49.718946 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f349af-d4bf-49e3-846b-2e03fa8bb4ea None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:49.719221 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f349af-d4bf-49e3-846b-2e03fa8bb4ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:49.736014 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f349af-d4bf-49e3-846b-2e03fa8bb4ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-e8f349af-d4bf-49e3-846b-2e03fa8bb4ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:49.745096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:49.746407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 196/368] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:49.748065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f349af-d4bf-49e3-846b-2e03fa8bb4ea None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:49.786264 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c4c06-97ce-4fc3-a194-c4aed53d082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:49.787356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4c06-97ce-4fc3-a194-c4aed53d082f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:49.787658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4c06-97ce-4fc3-a194-c4aed53d082f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:49.787995 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4c06-97ce-4fc3-a194-c4aed53d082f None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:49.789647 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c4c06-97ce-4fc3-a194-c4aed53d082f None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:49.791207 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c4c06-97ce-4fc3-a194-c4aed53d082f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:49.793106 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 173/369] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:49 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:49.794131 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c4c06-97ce-4fc3-a194-c4aed53d082f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:49.873458 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f349af-d4bf-49e3-846b-2e03fa8bb4ea None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:49.883847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:49.925696 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b030c65-c26b-4930-a7c5-14006708e4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:49.926349 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b030c65-c26b-4930-a7c5-14006708e4f8 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:49.926689 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b030c65-c26b-4930-a7c5-14006708e4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:49.927019 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b030c65-c26b-4930-a7c5-14006708e4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:49.927360 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c4c06-97ce-4fc3-a194-c4aed53d082f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:49.927823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b030c65-c26b-4930-a7c5-14006708e4f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:49.928475 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b030c65-c26b-4930-a7c5-14006708e4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:49.931515 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b030c65-c26b-4930-a7c5-14006708e4f8 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:49.944132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 197/370] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:49.949268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b030c65-c26b-4930-a7c5-14006708e4f8 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:49.963469 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:49.984363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99894-e5ab-4083-a37f-f00765f03fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:49.985667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99894-e5ab-4083-a37f-f00765f03fe8 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:49.986375 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99894-e5ab-4083-a37f-f00765f03fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:49.986882 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99894-e5ab-4083-a37f-f00765f03fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:49.987814 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99894-e5ab-4083-a37f-f00765f03fe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:49.988273 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99894-e5ab-4083-a37f-f00765f03fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:49.990839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99894-e5ab-4083-a37f-f00765f03fe8 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:50.003200 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 174/371] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:50.009679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99894-e5ab-4083-a37f-f00765f03fe8 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:50.082111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b030c65-c26b-4930-a7c5-14006708e4f8 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:50.124210 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b455b57-f350-48b7-a71a-ba59ed8bcaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:50.124880 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b455b57-f350-48b7-a71a-ba59ed8bcaea None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:50.125165 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b455b57-f350-48b7-a71a-ba59ed8bcaea None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:50.125441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b455b57-f350-48b7-a71a-ba59ed8bcaea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:50.126278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b455b57-f350-48b7-a71a-ba59ed8bcaea None admin] RBAC: Adding query filter params (group.id=37ec2266107f467c991bdbdd77290fa6, role.id=3ce491f94839419ea9ba3b84324fcd8f, scope.project.id=eab201cd44aa434290a1342e2a40c316) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:50.126611 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b455b57-f350-48b7-a71a-ba59ed8bcaea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:50.129291 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b455b57-f350-48b7-a71a-ba59ed8bcaea None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:50.135821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 198/372] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 14:15:49 2022] GET /identity/v3/role_assignments?group.id=37ec2266107f467c991bdbdd77290fa6&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:50.136719 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b455b57-f350-48b7-a71a-ba59ed8bcaea None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:50.162959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99894-e5ab-4083-a37f-f00765f03fe8 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:50.175380 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:50.212926 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51114c-745a-4461-bbb7-81918e2e2100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:50.214125 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51114c-745a-4461-bbb7-81918e2e2100 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:50.214626 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51114c-745a-4461-bbb7-81918e2e2100 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:50.215181 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51114c-745a-4461-bbb7-81918e2e2100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:50.256709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b455b57-f350-48b7-a71a-ba59ed8bcaea None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:50.278315 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:50.294441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f048b9b-7f95-4eb9-bdbf-fcc2dc74f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:50.295244 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f048b9b-7f95-4eb9-bdbf-fcc2dc74f561 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:50.295600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f048b9b-7f95-4eb9-bdbf-fcc2dc74f561 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:50.295910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f048b9b-7f95-4eb9-bdbf-fcc2dc74f561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:50.303046 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51114c-745a-4461-bbb7-81918e2e2100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:50.304847 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51114c-745a-4461-bbb7-81918e2e2100 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:50.373104 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f048b9b-7f95-4eb9-bdbf-fcc2dc74f561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:50.374665 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f048b9b-7f95-4eb9-bdbf-fcc2dc74f561 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:50.408086 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:50.425008 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 175/373] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:50.431891 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51114c-745a-4461-bbb7-81918e2e2100 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:50.490559 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 199/374] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:50.491831 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f048b9b-7f95-4eb9-bdbf-fcc2dc74f561 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:50.530700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:50.552408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51114c-745a-4461-bbb7-81918e2e2100 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:50.592026 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e38141-33c0-4683-8092-f1e43df0ba9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:50.593272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e38141-33c0-4683-8092-f1e43df0ba9f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:50.593763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e38141-33c0-4683-8092-f1e43df0ba9f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:50.594241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e38141-33c0-4683-8092-f1e43df0ba9f None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:50.595782 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e38141-33c0-4683-8092-f1e43df0ba9f None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:50.597466 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e38141-33c0-4683-8092-f1e43df0ba9f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:50.599780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 176/375] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:50 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:50.605453 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e38141-33c0-4683-8092-f1e43df0ba9f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:50.606195 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f048b9b-7f95-4eb9-bdbf-fcc2dc74f561 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:50.640459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:50.646031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd026805-30b1-46ff-ba80-63fe76256078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:50.647142 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd026805-30b1-46ff-ba80-63fe76256078 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:50.647254 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd026805-30b1-46ff-ba80-63fe76256078 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:50.647518 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd026805-30b1-46ff-ba80-63fe76256078 None admin] PATH_INFO: `/v3/projects/47e2c6597d274fcc88b12f356f1b2eb0` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:50.648817 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd026805-30b1-46ff-ba80-63fe76256078 None admin] RBAC: Authorizing `identity:get_project(project_id=47e2c6597d274fcc88b12f356f1b2eb0)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:50.650308 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd026805-30b1-46ff-ba80-63fe76256078 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:50.654586 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 200/376] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:50 2022] GET /identity/v3/projects/47e2c6597d274fcc88b12f356f1b2eb0 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:50.659305 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd026805-30b1-46ff-ba80-63fe76256078 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:50.729579 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e38141-33c0-4683-8092-f1e43df0ba9f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:50.771841 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a627fbd-3b0a-47a7-add9-777abf9c2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:50.772042 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd026805-30b1-46ff-ba80-63fe76256078 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:50.773158 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a627fbd-3b0a-47a7-add9-777abf9c2d79 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:50.773645 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a627fbd-3b0a-47a7-add9-777abf9c2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:50.774148 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a627fbd-3b0a-47a7-add9-777abf9c2d79 None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:50.775650 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a627fbd-3b0a-47a7-add9-777abf9c2d79 None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:50.777312 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a627fbd-3b0a-47a7-add9-777abf9c2d79 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:50.780390 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 177/377] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:50 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:50.786659 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a627fbd-3b0a-47a7-add9-777abf9c2d79 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:50.808240 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:50.809616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e2f07-6f2f-4e19-9b26-68bde2f0334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:50.811799 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e2f07-6f2f-4e19-9b26-68bde2f0334d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:50.811799 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e2f07-6f2f-4e19-9b26-68bde2f0334d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:50.811799 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e2f07-6f2f-4e19-9b26-68bde2f0334d None admin] PATH_INFO: `/v3/groups/24522e4c591543f58a2c3465041a954c` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:50.816702 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e2f07-6f2f-4e19-9b26-68bde2f0334d None admin] RBAC: Authorizing `identity:get_group(group_id=24522e4c591543f58a2c3465041a954c)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:50.823620 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e2f07-6f2f-4e19-9b26-68bde2f0334d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:50.823620 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 201/378] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:50 2022] GET /identity/v3/groups/24522e4c591543f58a2c3465041a954c => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:50.825858 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e2f07-6f2f-4e19-9b26-68bde2f0334d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:50.910840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a627fbd-3b0a-47a7-add9-777abf9c2d79 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:50.922987 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:50.950858 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e2f07-6f2f-4e19-9b26-68bde2f0334d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:50.952559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb610d-526f-444c-9653-ddd3edf6cb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:50.953403 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb610d-526f-444c-9653-ddd3edf6cb34 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:50.953753 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb610d-526f-444c-9653-ddd3edf6cb34 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:50.954041 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb610d-526f-444c-9653-ddd3edf6cb34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:50.955047 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb610d-526f-444c-9653-ddd3edf6cb34 None admin] RBAC: Adding query filter params (group.id=37ec2266107f467c991bdbdd77290fa6, role.id=5782703fc53f48f28fb7015ae693cd60, scope.project.id=eab201cd44aa434290a1342e2a40c316) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:50.955368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb610d-526f-444c-9653-ddd3edf6cb34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:50.956907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb610d-526f-444c-9653-ddd3edf6cb34 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:50.963378 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 178/379] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 14:15:50 2022] GET /identity/v3/role_assignments?group.id=37ec2266107f467c991bdbdd77290fa6&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=5782703fc53f48f28fb7015ae693cd60 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:50.989113 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b5ad1-099f-40b9-ad5b-d4323c1d4969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:50.989778 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b5ad1-099f-40b9-ad5b-d4323c1d4969 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:50.990065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b5ad1-099f-40b9-ad5b-d4323c1d4969 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:50.990347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b5ad1-099f-40b9-ad5b-d4323c1d4969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:50.991272 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b5ad1-099f-40b9-ad5b-d4323c1d4969 None admin] RBAC: Adding query filter params (group.id=24522e4c591543f58a2c3465041a954c, role.id=61482861f00e45048fc1d45570c4c99b, scope.project.id=47e2c6597d274fcc88b12f356f1b2eb0) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:50.991592 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b5ad1-099f-40b9-ad5b-d4323c1d4969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:50.993134 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b5ad1-099f-40b9-ad5b-d4323c1d4969 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:51.000370 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 202/380] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 14:15:50 2022] GET /identity/v3/role_assignments?group.id=24522e4c591543f58a2c3465041a954c&scope.project.id=47e2c6597d274fcc88b12f356f1b2eb0&role.id=61482861f00e45048fc1d45570c4c99b => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:52.004842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefff42f-d3b5-4d99-80b5-36f7421b2545 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:52.005379 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefff42f-d3b5-4d99-80b5-36f7421b2545 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:52.005379 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefff42f-d3b5-4d99-80b5-36f7421b2545 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:52.007082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 179/381] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:52.012365 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec21f7c-3ac9-4ff2-b4be-ad8f07c0d449 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:52.012769 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec21f7c-3ac9-4ff2-b4be-ad8f07c0d449 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:52.012936 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec21f7c-3ac9-4ff2-b4be-ad8f07c0d449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:52.030628 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-9ec21f7c-3ac9-4ff2-b4be-ad8f07c0d449 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:52.031840 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-9ec21f7c-3ac9-4ff2-b4be-ad8f07c0d449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:52.131226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 203/382] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:52.167913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefff42f-d3b5-4d99-80b5-36f7421b2545 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:52.272995 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:52.292724 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefff42f-d3b5-4d99-80b5-36f7421b2545 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:52.329067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a15251-d550-4999-9de7-4155d86e6983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:52.329893 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a15251-d550-4999-9de7-4155d86e6983 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:52.330625 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a15251-d550-4999-9de7-4155d86e6983 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:52.330936 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a15251-d550-4999-9de7-4155d86e6983 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:52.342672 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a15251-d550-4999-9de7-4155d86e6983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-f9a15251-d550-4999-9de7-4155d86e6983 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:52.350739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:52.351687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:52.352492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 180/383] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:52.363998 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec21f7c-3ac9-4ff2-b4be-ad8f07c0d449 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:52.451135 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:52.505789 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec21f7c-3ac9-4ff2-b4be-ad8f07c0d449 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:52.548356 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2486-2ca5-41c7-8390-429f9559e3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:52.549031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2486-2ca5-41c7-8390-429f9559e3bf None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:52.549315 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2486-2ca5-41c7-8390-429f9559e3bf None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:52.549590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2486-2ca5-41c7-8390-429f9559e3bf None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:52.550338 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f2486-2ca5-41c7-8390-429f9559e3bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:52.550661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f2486-2ca5-41c7-8390-429f9559e3bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:52.552038 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f2486-2ca5-41c7-8390-429f9559e3bf None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:52.564962 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 204/384] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:52.566252 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a15251-d550-4999-9de7-4155d86e6983 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:52.609509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd7e68-7d0d-499e-b7ed-66c769db18aa None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:52.609822 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd7e68-7d0d-499e-b7ed-66c769db18aa None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:52.610073 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd7e68-7d0d-499e-b7ed-66c769db18aa None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:52.611476 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 205/385] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:15:52.620302 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1a7ef-42f6-426e-adef-0de62cc580a0 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:52.620589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1a7ef-42f6-426e-adef-0de62cc580a0 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:52.620864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1a7ef-42f6-426e-adef-0de62cc580a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:52.638516 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-77c1a7ef-42f6-426e-adef-0de62cc580a0 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:52.648190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-77c1a7ef-42f6-426e-adef-0de62cc580a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:52.709878 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a15251-d550-4999-9de7-4155d86e6983 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:52.756939 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 206/386] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:52.772679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44578b3a-9c88-42a9-aef4-2329a16d18e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:52.773551 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44578b3a-9c88-42a9-aef4-2329a16d18e5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:52.773834 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44578b3a-9c88-42a9-aef4-2329a16d18e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:52.774111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44578b3a-9c88-42a9-aef4-2329a16d18e5 None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:52.775335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44578b3a-9c88-42a9-aef4-2329a16d18e5 None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:52.776840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44578b3a-9c88-42a9-aef4-2329a16d18e5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:52.783604 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 181/387] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:52 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:52.788840 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1a7ef-42f6-426e-adef-0de62cc580a0 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:52.789262 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44578b3a-9c88-42a9-aef4-2329a16d18e5 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:52.803580 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:52.904707 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:52.946789 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44578b3a-9c88-42a9-aef4-2329a16d18e5 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:53.002747 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b214e-26c3-47d8-9f17-030eb6487d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:53.003945 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b214e-26c3-47d8-9f17-030eb6487d04 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.004237 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b214e-26c3-47d8-9f17-030eb6487d04 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.004760 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b214e-26c3-47d8-9f17-030eb6487d04 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.006231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b214e-26c3-47d8-9f17-030eb6487d04 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:53.008187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b214e-26c3-47d8-9f17-030eb6487d04 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:53.010246 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 182/388] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:52 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:53.015847 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b214e-26c3-47d8-9f17-030eb6487d04 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:53.020249 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1a7ef-42f6-426e-adef-0de62cc580a0 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:53.092333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11a478-cd61-49bf-ada7-72b82ef44a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:53.093682 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a478-cd61-49bf-ada7-72b82ef44a30 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.094277 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a478-cd61-49bf-ada7-72b82ef44a30 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.094568 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a478-cd61-49bf-ada7-72b82ef44a30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.118906 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11a478-cd61-49bf-ada7-72b82ef44a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-5d11a478-cd61-49bf-ada7-72b82ef44a30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:53.134832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:53.135792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:53.136556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:53.144548 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 207/389] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:53.146085 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11a478-cd61-49bf-ada7-72b82ef44a30 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:53.160231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:53.224801 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b214e-26c3-47d8-9f17-030eb6487d04 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:53.256007 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11a478-cd61-49bf-ada7-72b82ef44a30 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:53.267941 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:53.292557 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a9bd5-01b3-4be6-ab74-5c2d77083621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:53.294052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a9bd5-01b3-4be6-ab74-5c2d77083621 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.294509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a9bd5-01b3-4be6-ab74-5c2d77083621 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.294972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a9bd5-01b3-4be6-ab74-5c2d77083621 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.295996 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a9bd5-01b3-4be6-ab74-5c2d77083621 None admin] RBAC: Adding query filter params (name=member) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:53.296596 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a9bd5-01b3-4be6-ab74-5c2d77083621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:53.298145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a9bd5-01b3-4be6-ab74-5c2d77083621 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:53.304321 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ec687-4468-4058-805c-673b80c1060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:53.304987 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ec687-4468-4058-805c-673b80c1060e None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.305275 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ec687-4468-4058-805c-673b80c1060e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.305554 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ec687-4468-4058-805c-673b80c1060e None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/groups/37ec2266107f467c991bdbdd77290fa6/roles/5782703fc53f48f28fb7015ae693cd60` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.312550 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ec687-4468-4058-805c-673b80c1060e None admin] RBAC: Authorizing `identity:create_grant(project_id=0530adf9f8454784a3bdf6998c1fc7b9, group_id=37ec2266107f467c991bdbdd77290fa6, role_id=5782703fc53f48f28fb7015ae693cd60)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:53.312820 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 208/390] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:53.314016 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ec687-4468-4058-805c-673b80c1060e None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:53.315938 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a9bd5-01b3-4be6-ab74-5c2d77083621 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:53.411017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 183/391] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 2 14:15:53 2022] PUT /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/groups/37ec2266107f467c991bdbdd77290fa6/roles/5782703fc53f48f28fb7015ae693cd60 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:15:53.419510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a9bd5-01b3-4be6-ab74-5c2d77083621 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:53.457891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0911f78-3d33-401f-839c-0526f85e3415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:53.459149 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911f78-3d33-401f-839c-0526f85e3415 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.459662 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911f78-3d33-401f-839c-0526f85e3415 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.460128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911f78-3d33-401f-839c-0526f85e3415 None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.461588 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0911f78-3d33-401f-839c-0526f85e3415 None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:53.463264 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0911f78-3d33-401f-839c-0526f85e3415 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:53.469822 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 209/392] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:53 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:53.471807 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ec687-4468-4058-805c-673b80c1060e None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:53.518111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860be44-9063-4682-84af-fcfef80826c0 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.518822 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860be44-9063-4682-84af-fcfef80826c0 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.519279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860be44-9063-4682-84af-fcfef80826c0 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.521311 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 210/393] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:53.527535 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd23a8c-0c13-4a12-acc7-d75ea522e90e None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.528280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd23a8c-0c13-4a12-acc7-d75ea522e90e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.528740 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd23a8c-0c13-4a12-acc7-d75ea522e90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.548472 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-3bd23a8c-0c13-4a12-acc7-d75ea522e90e None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:53.550191 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-3bd23a8c-0c13-4a12-acc7-d75ea522e90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:53.591101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:53.626604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 211/394] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:53.659981 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ec687-4468-4058-805c-673b80c1060e None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:53.676875 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd23a8c-0c13-4a12-acc7-d75ea522e90e None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:53.706801 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e196c9b-d643-4095-b458-494e352b2547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:53.707817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e196c9b-d643-4095-b458-494e352b2547 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.708168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e196c9b-d643-4095-b458-494e352b2547 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.708452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e196c9b-d643-4095-b458-494e352b2547 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.709985 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e196c9b-d643-4095-b458-494e352b2547 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:53.712056 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e196c9b-d643-4095-b458-494e352b2547 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:53.717839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 184/395] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:53 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:53.723136 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e196c9b-d643-4095-b458-494e352b2547 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:53.736770 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:53.819380 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd23a8c-0c13-4a12-acc7-d75ea522e90e None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:53.868434 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1700-8c9c-40d5-8a70-025b74f4a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:53.870050 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1700-8c9c-40d5-8a70-025b74f4a9df None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.870342 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1700-8c9c-40d5-8a70-025b74f4a9df None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.870620 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b1700-8c9c-40d5-8a70-025b74f4a9df None admin] PATH_INFO: `/v3/roles/member` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.900114 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b1700-8c9c-40d5-8a70-025b74f4a9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-9e8b1700-8c9c-40d5-8a70-025b74f4a9df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:53.911610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:53.912508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:53.913341 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:53.915736 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 212/396] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:15:53.919206 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e196c9b-d643-4095-b458-494e352b2547 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:53.922551 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1700-8c9c-40d5-8a70-025b74f4a9df None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:53.958077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd15a-9ee0-41ad-80de-ddc1800f0af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:53.959011 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd15a-9ee0-41ad-80de-ddc1800f0af8 None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:53.959295 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd15a-9ee0-41ad-80de-ddc1800f0af8 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:53.959675 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd15a-9ee0-41ad-80de-ddc1800f0af8 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/groups/37ec2266107f467c991bdbdd77290fa6/roles/3ce491f94839419ea9ba3b84324fcd8f` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:53.962282 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cd15a-9ee0-41ad-80de-ddc1800f0af8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0530adf9f8454784a3bdf6998c1fc7b9, group_id=37ec2266107f467c991bdbdd77290fa6, role_id=3ce491f94839419ea9ba3b84324fcd8f)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:53.964068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cd15a-9ee0-41ad-80de-ddc1800f0af8 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:53.985018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:54.046658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 185/397] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 2 14:15:53 2022] PUT /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9/groups/37ec2266107f467c991bdbdd77290fa6/roles/3ce491f94839419ea9ba3b84324fcd8f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:54.081667 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b1700-8c9c-40d5-8a70-025b74f4a9df None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:54.114944 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317a7a1-9e28-4d73-afc2-04539beac021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:54.115677 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317a7a1-9e28-4d73-afc2-04539beac021 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.115971 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317a7a1-9e28-4d73-afc2-04539beac021 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.124936 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317a7a1-9e28-4d73-afc2-04539beac021 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.124936 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317a7a1-9e28-4d73-afc2-04539beac021 None admin] RBAC: Adding query filter params (name=member) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:54.124936 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317a7a1-9e28-4d73-afc2-04539beac021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:54.124936 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317a7a1-9e28-4d73-afc2-04539beac021 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:54.129911 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 213/398] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:54.135971 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd15a-9ee0-41ad-80de-ddc1800f0af8 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:54.178674 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eada55-4736-4946-a884-c2e6762b874b None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.178981 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eada55-4736-4946-a884-c2e6762b874b None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.179265 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eada55-4736-4946-a884-c2e6762b874b None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.181839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 214/399] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:54.188950 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f351-d4e8-4bcb-ade7-e27dd495fadd None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.189270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f351-d4e8-4bcb-ade7-e27dd495fadd None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.189522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7f351-d4e8-4bcb-ade7-e27dd495fadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.219840 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-c5c7f351-d4e8-4bcb-ade7-e27dd495fadd None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:54.221075 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-c5c7f351-d4e8-4bcb-ade7-e27dd495fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:54.226439 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:54.269022 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd15a-9ee0-41ad-80de-ddc1800f0af8 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:54.310499 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879649bc-207c-41fb-bf96-9f0eed652dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:54.311041 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 215/400] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:54.311417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879649bc-207c-41fb-bf96-9f0eed652dbf None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.311704 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879649bc-207c-41fb-bf96-9f0eed652dbf None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.311984 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879649bc-207c-41fb-bf96-9f0eed652dbf None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.312575 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c3925-0120-4f71-bafc-0247b25162fc None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.312873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c3925-0120-4f71-bafc-0247b25162fc None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.313160 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c3925-0120-4f71-bafc-0247b25162fc None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.313311 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879649bc-207c-41fb-bf96-9f0eed652dbf None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:54.314726 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 216/401] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:54.314921 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879649bc-207c-41fb-bf96-9f0eed652dbf None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:54.316854 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 186/402] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:54 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:54.322193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c3925-0120-4f71-bafc-0247b25162fc None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:54.330712 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da178cd5-5da7-4d07-9d00-28dbc1e46853 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.330712 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da178cd5-5da7-4d07-9d00-28dbc1e46853 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.330712 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da178cd5-5da7-4d07-9d00-28dbc1e46853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.350036 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-da178cd5-5da7-4d07-9d00-28dbc1e46853 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:54.351970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-da178cd5-5da7-4d07-9d00-28dbc1e46853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:54.361839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:54.452329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 187/403] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:54.453597 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da178cd5-5da7-4d07-9d00-28dbc1e46853 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:54.488349 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c3925-0120-4f71-bafc-0247b25162fc None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:54.526468 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:54.529521 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4373d-0f8d-4ba1-89eb-f122dff9a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:54.530398 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4373d-0f8d-4ba1-89eb-f122dff9a522 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.538854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4373d-0f8d-4ba1-89eb-f122dff9a522 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.538854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4373d-0f8d-4ba1-89eb-f122dff9a522 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.538854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4373d-0f8d-4ba1-89eb-f122dff9a522 None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:54.538854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4373d-0f8d-4ba1-89eb-f122dff9a522 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:54.538854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 217/404] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:54 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:54.538854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4373d-0f8d-4ba1-89eb-f122dff9a522 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:54.571402 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da178cd5-5da7-4d07-9d00-28dbc1e46853 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:54.610685 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663af42d-ed6a-4e4b-8af4-bc7638cc9474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:54.611719 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663af42d-ed6a-4e4b-8af4-bc7638cc9474 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.612151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663af42d-ed6a-4e4b-8af4-bc7638cc9474 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.612597 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663af42d-ed6a-4e4b-8af4-bc7638cc9474 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.624924 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663af42d-ed6a-4e4b-8af4-bc7638cc9474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-663af42d-ed6a-4e4b-8af4-bc7638cc9474 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:54.633940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:54.635143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:54.636040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:54.637088 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:54.645010 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 188/405] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:54.653027 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663af42d-ed6a-4e4b-8af4-bc7638cc9474 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:54.653153 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4373d-0f8d-4ba1-89eb-f122dff9a522 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:54.683380 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38224fd-f127-48be-8feb-ba752044af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:54.684732 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38224fd-f127-48be-8feb-ba752044af0c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.684955 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38224fd-f127-48be-8feb-ba752044af0c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.685260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38224fd-f127-48be-8feb-ba752044af0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.696325 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38224fd-f127-48be-8feb-ba752044af0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-f38224fd-f127-48be-8feb-ba752044af0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:54.705271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:54.706336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:54.707193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 218/406] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:54.711800 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38224fd-f127-48be-8feb-ba752044af0c None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:54.776809 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663af42d-ed6a-4e4b-8af4-bc7638cc9474 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:54.804959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:54.817387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2eb5b-e343-47d9-a42d-6b8d0c31259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:54.818663 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2eb5b-e343-47d9-a42d-6b8d0c31259e None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.819120 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2eb5b-e343-47d9-a42d-6b8d0c31259e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.819543 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2eb5b-e343-47d9-a42d-6b8d0c31259e None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316/groups/37ec2266107f467c991bdbdd77290fa6/roles/3ce491f94839419ea9ba3b84324fcd8f` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.821956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2eb5b-e343-47d9-a42d-6b8d0c31259e None admin] RBAC: Authorizing `identity:create_grant(project_id=eab201cd44aa434290a1342e2a40c316, group_id=37ec2266107f467c991bdbdd77290fa6, role_id=3ce491f94839419ea9ba3b84324fcd8f)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:54.823605 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2eb5b-e343-47d9-a42d-6b8d0c31259e None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:54.839025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38224fd-f127-48be-8feb-ba752044af0c None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:54.884844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37815cfa-3539-405a-81a6-12d10ebea20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:54.884945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37815cfa-3539-405a-81a6-12d10ebea20b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:54.885219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37815cfa-3539-405a-81a6-12d10ebea20b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:54.885503 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37815cfa-3539-405a-81a6-12d10ebea20b None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:54.886264 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37815cfa-3539-405a-81a6-12d10ebea20b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:54.886659 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37815cfa-3539-405a-81a6-12d10ebea20b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:54.888202 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37815cfa-3539-405a-81a6-12d10ebea20b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:54.902190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 219/407] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:54.902190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37815cfa-3539-405a-81a6-12d10ebea20b None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:54.918064 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:54.930794 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 189/408] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 2 14:15:54 2022] PUT /identity/v3/projects/eab201cd44aa434290a1342e2a40c316/groups/37ec2266107f467c991bdbdd77290fa6/roles/3ce491f94839419ea9ba3b84324fcd8f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:54.931624 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2eb5b-e343-47d9-a42d-6b8d0c31259e None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:55.043204 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37815cfa-3539-405a-81a6-12d10ebea20b None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:55.070989 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2eb5b-e343-47d9-a42d-6b8d0c31259e None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:55.093913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6532452-0a2d-4f0a-a578-8b1fa003aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:55.095441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532452-0a2d-4f0a-a578-8b1fa003aacc None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:55.096095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532452-0a2d-4f0a-a578-8b1fa003aacc None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:55.096536 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532452-0a2d-4f0a-a578-8b1fa003aacc None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:55.097454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6532452-0a2d-4f0a-a578-8b1fa003aacc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:55.101787 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6532452-0a2d-4f0a-a578-8b1fa003aacc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:55.101787 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6532452-0a2d-4f0a-a578-8b1fa003aacc None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:55.112499 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 220/409] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:55.118001 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6532452-0a2d-4f0a-a578-8b1fa003aacc None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:55.137426 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414733b-a7fe-421b-9e0f-49884b848861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:55.141490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414733b-a7fe-421b-9e0f-49884b848861 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:55.142009 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414733b-a7fe-421b-9e0f-49884b848861 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:55.142615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414733b-a7fe-421b-9e0f-49884b848861 None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:55.146304 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414733b-a7fe-421b-9e0f-49884b848861 None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:55.149416 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414733b-a7fe-421b-9e0f-49884b848861 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:55.161258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 190/410] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:54 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:55.162546 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414733b-a7fe-421b-9e0f-49884b848861 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:55.254349 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:55.256522 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:55.287700 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6532452-0a2d-4f0a-a578-8b1fa003aacc None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:55.311480 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414733b-a7fe-421b-9e0f-49884b848861 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:55.333501 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651b1ca-a814-41a8-abf5-580834a8e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:55.335085 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651b1ca-a814-41a8-abf5-580834a8e669 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:55.335688 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651b1ca-a814-41a8-abf5-580834a8e669 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:55.336237 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651b1ca-a814-41a8-abf5-580834a8e669 None admin] PATH_INFO: `/v3/groups/24522e4c591543f58a2c3465041a954c` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:55.338056 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651b1ca-a814-41a8-abf5-580834a8e669 None admin] RBAC: Authorizing `identity:get_group(group_id=24522e4c591543f58a2c3465041a954c)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:55.342253 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651b1ca-a814-41a8-abf5-580834a8e669 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:55.347395 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 221/411] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:55 2022] GET /identity/v3/groups/24522e4c591543f58a2c3465041a954c => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:55.350358 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651b1ca-a814-41a8-abf5-580834a8e669 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:55.352394 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865bd3f-2f50-4b86-aac8-8b13043347a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:55.353590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865bd3f-2f50-4b86-aac8-8b13043347a0 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:55.354046 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865bd3f-2f50-4b86-aac8-8b13043347a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:55.354494 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865bd3f-2f50-4b86-aac8-8b13043347a0 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:55.356479 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865bd3f-2f50-4b86-aac8-8b13043347a0 None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:55.359359 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865bd3f-2f50-4b86-aac8-8b13043347a0 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:55.362050 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 191/412] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:55 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:55.368652 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865bd3f-2f50-4b86-aac8-8b13043347a0 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:55.520327 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651b1ca-a814-41a8-abf5-580834a8e669 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:55.528902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865bd3f-2f50-4b86-aac8-8b13043347a0 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:55.555579 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906a7eb-3b6c-48bc-a0fc-85694b5af9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:55.556451 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906a7eb-3b6c-48bc-a0fc-85694b5af9fe None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:55.556738 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906a7eb-3b6c-48bc-a0fc-85694b5af9fe None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:55.557016 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906a7eb-3b6c-48bc-a0fc-85694b5af9fe None admin] PATH_INFO: `/v3/projects/47e2c6597d274fcc88b12f356f1b2eb0` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:55.558252 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906a7eb-3b6c-48bc-a0fc-85694b5af9fe None admin] RBAC: Authorizing `identity:get_project(project_id=47e2c6597d274fcc88b12f356f1b2eb0)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:55.560006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906a7eb-3b6c-48bc-a0fc-85694b5af9fe None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:55.561752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 222/413] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:55 2022] GET /identity/v3/projects/47e2c6597d274fcc88b12f356f1b2eb0 => generated 344 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:55.568295 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906a7eb-3b6c-48bc-a0fc-85694b5af9fe None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:55.573240 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:55.591032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:55.607989 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed30b09-c355-4162-b256-2188f0dca212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:55.608888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed30b09-c355-4162-b256-2188f0dca212 None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:55.609175 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed30b09-c355-4162-b256-2188f0dca212 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:55.609453 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed30b09-c355-4162-b256-2188f0dca212 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316/groups/37ec2266107f467c991bdbdd77290fa6/roles/5782703fc53f48f28fb7015ae693cd60` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:55.614325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed30b09-c355-4162-b256-2188f0dca212 None admin] RBAC: Authorizing `identity:create_grant(project_id=eab201cd44aa434290a1342e2a40c316, group_id=37ec2266107f467c991bdbdd77290fa6, role_id=5782703fc53f48f28fb7015ae693cd60)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:55.615818 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed30b09-c355-4162-b256-2188f0dca212 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:55.699742 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 192/414] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 2 14:15:55 2022] PUT /identity/v3/projects/eab201cd44aa434290a1342e2a40c316/groups/37ec2266107f467c991bdbdd77290fa6/roles/5782703fc53f48f28fb7015ae693cd60 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:15:55.705186 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906a7eb-3b6c-48bc-a0fc-85694b5af9fe None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:55.744251 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70a6c1-2fe3-4e95-a5bd-67f002bf218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:55.745154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70a6c1-2fe3-4e95-a5bd-67f002bf218f None admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:55.745442 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70a6c1-2fe3-4e95-a5bd-67f002bf218f None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:55.745721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70a6c1-2fe3-4e95-a5bd-67f002bf218f None admin] PATH_INFO: `/v3/projects/47e2c6597d274fcc88b12f356f1b2eb0/groups/24522e4c591543f58a2c3465041a954c/roles/61482861f00e45048fc1d45570c4c99b` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:55.747868 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70a6c1-2fe3-4e95-a5bd-67f002bf218f None admin] RBAC: Authorizing `identity:create_grant(project_id=47e2c6597d274fcc88b12f356f1b2eb0, group_id=24522e4c591543f58a2c3465041a954c, role_id=61482861f00e45048fc1d45570c4c99b)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:55.749345 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70a6c1-2fe3-4e95-a5bd-67f002bf218f None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:55.867974 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 223/415] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Jun 2 14:15:55 2022] PUT /identity/v3/projects/47e2c6597d274fcc88b12f356f1b2eb0/groups/24522e4c591543f58a2c3465041a954c/roles/61482861f00e45048fc1d45570c4c99b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:56.287158 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe673-24c6-4930-bc04-c36fca8e1468 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:56.287668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe673-24c6-4930-bc04-c36fca8e1468 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:56.287668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe673-24c6-4930-bc04-c36fca8e1468 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:56.289059 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 193/416] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:56.295077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d17b3-18a3-4739-b098-a8a255273fef None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:56.295589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d17b3-18a3-4739-b098-a8a255273fef None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:56.295697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d17b3-18a3-4739-b098-a8a255273fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:56.315762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-b56d17b3-18a3-4739-b098-a8a255273fef None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:56.317004 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-b56d17b3-18a3-4739-b098-a8a255273fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:56.414567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:56.422458 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 224/417] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:56.461387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe673-24c6-4930-bc04-c36fca8e1468 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:56.614129 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe673-24c6-4930-bc04-c36fca8e1468 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:56.649929 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d023d61-0c10-495b-b1ff-09d0d5ca0acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:56.651164 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d023d61-0c10-495b-b1ff-09d0d5ca0acd None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:56.651644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d023d61-0c10-495b-b1ff-09d0d5ca0acd None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:56.652187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d023d61-0c10-495b-b1ff-09d0d5ca0acd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:56.663627 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d023d61-0c10-495b-b1ff-09d0d5ca0acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-3d023d61-0c10-495b-b1ff-09d0d5ca0acd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:56.672798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:56.673703 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:56.674475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:56.677269 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 194/418] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:56.683273 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d17b3-18a3-4739-b098-a8a255273fef None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:56.724917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637833c5-2d89-4615-93bc-9b7ab5b8d468 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:56.725233 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637833c5-2d89-4615-93bc-9b7ab5b8d468 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:56.725481 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637833c5-2d89-4615-93bc-9b7ab5b8d468 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:56.727155 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 195/419] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:56.732034 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6dc6-0266-4739-92dc-d719d8c2ccf1 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:56.732333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6dc6-0266-4739-92dc-d719d8c2ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:56.732609 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6dc6-0266-4739-92dc-d719d8c2ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:56.751733 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-477c6dc6-0266-4739-92dc-d719d8c2ccf1 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:56.753109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-477c6dc6-0266-4739-92dc-d719d8c2ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:56.800093 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:56.804811 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d17b3-18a3-4739-b098-a8a255273fef None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:56.842066 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02118ac2-3c95-479c-b729-7885d64fae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:56.843185 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02118ac2-3c95-479c-b729-7885d64fae4e None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:56.843651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 196/420] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:56.843854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02118ac2-3c95-479c-b729-7885d64fae4e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:56.844334 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02118ac2-3c95-479c-b729-7885d64fae4e None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:56.845284 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02118ac2-3c95-479c-b729-7885d64fae4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:56.845855 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02118ac2-3c95-479c-b729-7885d64fae4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:56.847451 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02118ac2-3c95-479c-b729-7885d64fae4e None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:56.859152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 225/421] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:56.865735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6dc6-0266-4739-92dc-d719d8c2ccf1 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:56.869962 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02118ac2-3c95-479c-b729-7885d64fae4e None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:56.939531 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:56.982419 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02118ac2-3c95-479c-b729-7885d64fae4e None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:57.019586 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a87f6-7804-4268-97a2-f6faeb582c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:57.020398 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a87f6-7804-4268-97a2-f6faeb582c62 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:57.020689 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a87f6-7804-4268-97a2-f6faeb582c62 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:57.020969 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a87f6-7804-4268-97a2-f6faeb582c62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:57.032550 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a87f6-7804-4268-97a2-f6faeb582c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-ad2a87f6-7804-4268-97a2-f6faeb582c62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:57.040720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:57.041618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:57.042428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 226/422] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:57.047963 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a87f6-7804-4268-97a2-f6faeb582c62 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:57.057216 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6dc6-0266-4739-92dc-d719d8c2ccf1 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:57.110272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e46b-d801-4cad-9062-3b2cd466dc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:57.111329 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e46b-d801-4cad-9062-3b2cd466dc2f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:57.112171 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e46b-d801-4cad-9062-3b2cd466dc2f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:57.114062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e46b-d801-4cad-9062-3b2cd466dc2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:57.190768 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:57.219768 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a87f6-7804-4268-97a2-f6faeb582c62 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:57.246327 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9e46b-d801-4cad-9062-3b2cd466dc2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:57.248766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9e46b-d801-4cad-9062-3b2cd466dc2f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:57.266294 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:57.287842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94939bb3-c3fe-4883-b9c3-7c5299e07422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:57.289376 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94939bb3-c3fe-4883-b9c3-7c5299e07422 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:57.290158 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94939bb3-c3fe-4883-b9c3-7c5299e07422 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:57.291745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94939bb3-c3fe-4883-b9c3-7c5299e07422 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:57.292700 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94939bb3-c3fe-4883-b9c3-7c5299e07422 None admin] RBAC: Adding query filter params (name=member) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:57.293370 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94939bb3-c3fe-4883-b9c3-7c5299e07422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:57.296893 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94939bb3-c3fe-4883-b9c3-7c5299e07422 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:57.312856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 227/423] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:57.319348 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94939bb3-c3fe-4883-b9c3-7c5299e07422 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:57.446499 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 197/424] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:57.453055 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e46b-d801-4cad-9062-3b2cd466dc2f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:57.529716 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94939bb3-c3fe-4883-b9c3-7c5299e07422 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:57.570088 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e700-4f26-4a46-a208-90d1a3453b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:57.570780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e700-4f26-4a46-a208-90d1a3453b3c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:57.571070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e700-4f26-4a46-a208-90d1a3453b3c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:57.573806 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e700-4f26-4a46-a208-90d1a3453b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:57.600972 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:57.655686 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e46b-d801-4cad-9062-3b2cd466dc2f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:57.675413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:57.703795 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372e700-4f26-4a46-a208-90d1a3453b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:57.705183 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372e700-4f26-4a46-a208-90d1a3453b3c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:57.724360 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b242b-790c-4aea-b80e-006fe69aa939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:57.725238 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b242b-790c-4aea-b80e-006fe69aa939 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:57.725518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b242b-790c-4aea-b80e-006fe69aa939 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:57.725794 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b242b-790c-4aea-b80e-006fe69aa939 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:57.728566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b242b-790c-4aea-b80e-006fe69aa939 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:57.730019 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b242b-790c-4aea-b80e-006fe69aa939 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:57.738994 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 198/425] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:57 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:57.744116 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b242b-790c-4aea-b80e-006fe69aa939 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:57.841524 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 228/426] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:57.847010 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e700-4f26-4a46-a208-90d1a3453b3c None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:57.933574 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b242b-790c-4aea-b80e-006fe69aa939 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:57.943837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:57.969595 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e700-4f26-4a46-a208-90d1a3453b3c None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:57.978812 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d86f74-bb28-441f-9a06-fece27d6681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:57.990176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d86f74-bb28-441f-9a06-fece27d6681e None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:57.990176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d86f74-bb28-441f-9a06-fece27d6681e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:57.990176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d86f74-bb28-441f-9a06-fece27d6681e None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:57.990176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d86f74-bb28-441f-9a06-fece27d6681e None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:57.990176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d86f74-bb28-441f-9a06-fece27d6681e None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:57.990176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 199/427] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:57 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:57.990686 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f4bb-b093-4919-8aae-cdaaf208654d None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:57.990686 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f4bb-b093-4919-8aae-cdaaf208654d None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:57.990686 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f4bb-b093-4919-8aae-cdaaf208654d None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:57.991268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 200/428] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:57.995735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f4bb-b093-4919-8aae-cdaaf208654d None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:58.006224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:58.010169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b5cab-eeb9-4b49-9cb4-b1aafc1dd356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:58.011428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b5cab-eeb9-4b49-9cb4-b1aafc1dd356 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.011720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b5cab-eeb9-4b49-9cb4-b1aafc1dd356 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.012005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b5cab-eeb9-4b49-9cb4-b1aafc1dd356 None admin] PATH_INFO: `/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.014039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b5cab-eeb9-4b49-9cb4-b1aafc1dd356 None admin] RBAC: Authorizing `identity:get_project(project_id=0530adf9f8454784a3bdf6998c1fc7b9)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:58.015706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b5cab-eeb9-4b49-9cb4-b1aafc1dd356 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:58.018286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 229/429] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:57 2022] GET /identity/v3/projects/0530adf9f8454784a3bdf6998c1fc7b9 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:58.024610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980da83-1652-4551-bec5-98bf70b252e7 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.024900 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980da83-1652-4551-bec5-98bf70b252e7 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.025179 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980da83-1652-4551-bec5-98bf70b252e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.053097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-c980da83-1652-4551-bec5-98bf70b252e7 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:58.054298 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-c980da83-1652-4551-bec5-98bf70b252e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:58.132353 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f4bb-b093-4919-8aae-cdaaf208654d None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:58.138761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 230/430] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:58.139885 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980da83-1652-4551-bec5-98bf70b252e7 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:58.172172 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed518a-7724-437f-a223-d5bbc1751946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:58.173323 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed518a-7724-437f-a223-d5bbc1751946 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.173807 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed518a-7724-437f-a223-d5bbc1751946 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.174305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed518a-7724-437f-a223-d5bbc1751946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.175718 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed518a-7724-437f-a223-d5bbc1751946 None admin] RBAC: Adding query filter params (group.id=37ec2266107f467c991bdbdd77290fa6, role.id=5782703fc53f48f28fb7015ae693cd60, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:58.176239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed518a-7724-437f-a223-d5bbc1751946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:58.178356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed518a-7724-437f-a223-d5bbc1751946 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:58.187228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 201/431] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 14:15:57 2022] GET /identity/v3/role_assignments?group.id=37ec2266107f467c991bdbdd77290fa6&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=5782703fc53f48f28fb7015ae693cd60 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:58.187789 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed518a-7724-437f-a223-d5bbc1751946 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:58.264266 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:58.286732 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980da83-1652-4551-bec5-98bf70b252e7 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:58.330517 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f988150-197d-4f59-9669-286d6d9dfb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:58.331825 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f988150-197d-4f59-9669-286d6d9dfb47 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.332213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f988150-197d-4f59-9669-286d6d9dfb47 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.332592 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f988150-197d-4f59-9669-286d6d9dfb47 None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.334226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f988150-197d-4f59-9669-286d6d9dfb47 None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:58.336301 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f988150-197d-4f59-9669-286d6d9dfb47 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:58.338562 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 231/432] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:58 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:58.345838 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f988150-197d-4f59-9669-286d6d9dfb47 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:58.386609 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:58.431750 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed518a-7724-437f-a223-d5bbc1751946 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:58.480328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5892c-a77b-40f8-bf4b-826b036efa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:58.481774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5892c-a77b-40f8-bf4b-826b036efa6a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.482125 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5892c-a77b-40f8-bf4b-826b036efa6a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.482470 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5892c-a77b-40f8-bf4b-826b036efa6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.483652 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f988150-197d-4f59-9669-286d6d9dfb47 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:58.496920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5892c-a77b-40f8-bf4b-826b036efa6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-c9e5892c-a77b-40f8-bf4b-826b036efa6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:58.506497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:58.507631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 14:15:58.508464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:58.509098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 202/433] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:58.515690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5892c-a77b-40f8-bf4b-826b036efa6a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:58.529213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db55ce6-1aeb-40e2-b3ac-eecb6100f708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:58.530006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db55ce6-1aeb-40e2-b3ac-eecb6100f708 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.530365 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db55ce6-1aeb-40e2-b3ac-eecb6100f708 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.531768 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db55ce6-1aeb-40e2-b3ac-eecb6100f708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.533019 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db55ce6-1aeb-40e2-b3ac-eecb6100f708 None admin] RBAC: Adding query filter params (group.id=37ec2266107f467c991bdbdd77290fa6, role.id=3ce491f94839419ea9ba3b84324fcd8f, scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:58.533408 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db55ce6-1aeb-40e2-b3ac-eecb6100f708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:58.535728 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db55ce6-1aeb-40e2-b3ac-eecb6100f708 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:58.546098 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 232/434] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 14:15:58 2022] GET /identity/v3/role_assignments?group.id=37ec2266107f467c991bdbdd77290fa6&scope.project.id=0530adf9f8454784a3bdf6998c1fc7b9&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:58.652684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5892c-a77b-40f8-bf4b-826b036efa6a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:58.687060 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:58.694770 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24732012-017c-49de-b2f6-f14b062f08f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:58.695464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732012-017c-49de-b2f6-f14b062f08f5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.695803 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732012-017c-49de-b2f6-f14b062f08f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.696017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732012-017c-49de-b2f6-f14b062f08f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.696783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24732012-017c-49de-b2f6-f14b062f08f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:58.697090 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24732012-017c-49de-b2f6-f14b062f08f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:58.698505 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24732012-017c-49de-b2f6-f14b062f08f5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:58.709672 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 203/435] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:15:58.715944 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db55ce6-1aeb-40e2-b3ac-eecb6100f708 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:58.736859 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:58.801678 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809da0f7-24b8-4cfb-af42-52f97b5283f1 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.801960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809da0f7-24b8-4cfb-af42-52f97b5283f1 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.802153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809da0f7-24b8-4cfb-af42-52f97b5283f1 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.804701 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 204/436] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:58.808843 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b86f-f266-4505-ab26-1f1467030461 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.809196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b86f-f266-4505-ab26-1f1467030461 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.809961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b86f-f266-4505-ab26-1f1467030461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.827962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-4998b86f-f266-4505-ab26-1f1467030461 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:58.828794 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-4998b86f-f266-4505-ab26-1f1467030461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:58.835220 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db55ce6-1aeb-40e2-b3ac-eecb6100f708 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:58.876336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e35f0-b2f2-40e0-9836-c3319d9e74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:58.876993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e35f0-b2f2-40e0-9836-c3319d9e74e6 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.877458 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e35f0-b2f2-40e0-9836-c3319d9e74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.877736 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e35f0-b2f2-40e0-9836-c3319d9e74e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.915930 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 205/437] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:15:58.917284 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309ec47-ed8f-45d1-aa99-5e1a8a5b1b15 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.917578 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309ec47-ed8f-45d1-aa99-5e1a8a5b1b15 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.917917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309ec47-ed8f-45d1-aa99-5e1a8a5b1b15 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.919981 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 206/438] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:15:58.925543 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7daa7-2219-4a8a-9596-711264928eb8 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:58.925838 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7daa7-2219-4a8a-9596-711264928eb8 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:58.926122 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7daa7-2219-4a8a-9596-711264928eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:58.947008 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-aba7daa7-2219-4a8a-9596-711264928eb8 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:15:58.948224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-aba7daa7-2219-4a8a-9596-711264928eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:15:58.962121 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e35f0-b2f2-40e0-9836-c3319d9e74e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:58.966087 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e35f0-b2f2-40e0-9836-c3319d9e74e6 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:58.982086 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:59.036040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 207/439] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:15:59.037540 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7daa7-2219-4a8a-9596-711264928eb8 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.103995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 233/440] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:59.103995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e35f0-b2f2-40e0-9836-c3319d9e74e6 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.104303 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:59.153130 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7daa7-2219-4a8a-9596-711264928eb8 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:59.196340 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a998-2463-497d-80db-fdde73778a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:59.197153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a998-2463-497d-80db-fdde73778a7f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:59.197439 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a998-2463-497d-80db-fdde73778a7f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:59.197717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a998-2463-497d-80db-fdde73778a7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:59.203673 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e35f0-b2f2-40e0-9836-c3319d9e74e6 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:59.209978 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1a998-2463-497d-80db-fdde73778a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:59.219488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-aeb1a998-2463-497d-80db-fdde73778a7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:59.220174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:59.221040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:15:59.222080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 208/441] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:59.224128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a998-2463-497d-80db-fdde73778a7f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.241065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd64076-8b3b-4312-be36-806627391a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:59.241858 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd64076-8b3b-4312-be36-806627391a57 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:59.242137 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd64076-8b3b-4312-be36-806627391a57 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:59.242408 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd64076-8b3b-4312-be36-806627391a57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:59.253550 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd64076-8b3b-4312-be36-806627391a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-1dd64076-8b3b-4312-be36-806627391a57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:15:59.261708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:15:59.262672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 234/442] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:15:59.265830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd64076-8b3b-4312-be36-806627391a57 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.327383 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a998-2463-497d-80db-fdde73778a7f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:59.339604 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:59.360949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c63e16-c0be-482f-beb6-18accc329800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:59.361747 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c63e16-c0be-482f-beb6-18accc329800 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:59.362035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c63e16-c0be-482f-beb6-18accc329800 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:59.362316 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c63e16-c0be-482f-beb6-18accc329800 None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:59.363572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c63e16-c0be-482f-beb6-18accc329800 None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:59.365016 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c63e16-c0be-482f-beb6-18accc329800 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:59.365644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd64076-8b3b-4312-be36-806627391a57 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:59.366721 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 209/443] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:59.372227 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c63e16-c0be-482f-beb6-18accc329800 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.400991 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee0b7d-ce29-45e0-8db7-6a8ff08b410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:59.401656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0b7d-ce29-45e0-8db7-6a8ff08b410a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:59.401942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0b7d-ce29-45e0-8db7-6a8ff08b410a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:59.402221 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0b7d-ce29-45e0-8db7-6a8ff08b410a None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:59.403003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee0b7d-ce29-45e0-8db7-6a8ff08b410a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:59.403312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee0b7d-ce29-45e0-8db7-6a8ff08b410a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:59.404702 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee0b7d-ce29-45e0-8db7-6a8ff08b410a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:59.412477 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 235/444] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:59.415478 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee0b7d-ce29-45e0-8db7-6a8ff08b410a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.451978 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:59.466904 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c63e16-c0be-482f-beb6-18accc329800 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:59.500185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eee42-1659-466f-9839-355ef18a0bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:59.500847 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eee42-1659-466f-9839-355ef18a0bf5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:59.501129 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eee42-1659-466f-9839-355ef18a0bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:59.501406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eee42-1659-466f-9839-355ef18a0bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:59.502152 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eee42-1659-466f-9839-355ef18a0bf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:59.502460 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eee42-1659-466f-9839-355ef18a0bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:59.503870 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eee42-1659-466f-9839-355ef18a0bf5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:59.512060 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 210/445] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:59.513422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eee42-1659-466f-9839-355ef18a0bf5 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.520689 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee0b7d-ce29-45e0-8db7-6a8ff08b410a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:59.554267 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c9664-a971-4471-ad59-de1aa074259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:59.555146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c9664-a971-4471-ad59-de1aa074259f None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:59.555554 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c9664-a971-4471-ad59-de1aa074259f None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:59.555665 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:59.555752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c9664-a971-4471-ad59-de1aa074259f None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:59.557016 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c9664-a971-4471-ad59-de1aa074259f None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:59.558522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c9664-a971-4471-ad59-de1aa074259f None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:59.560208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 236/446] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:59.560968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c9664-a971-4471-ad59-de1aa074259f None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.612164 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eee42-1659-466f-9839-355ef18a0bf5 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:59.645883 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d9795-1a1e-4bc5-9a29-93813e7286ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:59.646552 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9795-1a1e-4bc5-9a29-93813e7286ca None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:59.646870 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9795-1a1e-4bc5-9a29-93813e7286ca None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:59.647147 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9795-1a1e-4bc5-9a29-93813e7286ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:59.661025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c9664-a971-4471-ad59-de1aa074259f None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:59.663287 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:59.696306 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd798fd-e559-45af-a743-c8a084b52026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:59.696945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd798fd-e559-45af-a743-c8a084b52026 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:59.697229 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd798fd-e559-45af-a743-c8a084b52026 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:59.697506 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd798fd-e559-45af-a743-c8a084b52026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:59.715786 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d9795-1a1e-4bc5-9a29-93813e7286ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:59.717478 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d9795-1a1e-4bc5-9a29-93813e7286ca None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:59.761040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:59.764943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd798fd-e559-45af-a743-c8a084b52026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:59.766422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd798fd-e559-45af-a743-c8a084b52026 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:59.819252 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 211/447] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:59.820096 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d9795-1a1e-4bc5-9a29-93813e7286ca None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.865722 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 237/448] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:15:59.866479 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd798fd-e559-45af-a743-c8a084b52026 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.869429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:59.924502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d9795-1a1e-4bc5-9a29-93813e7286ca None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:59.958403 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc671c9f-612d-440d-a3c6-67534a104edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:15:59.959086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc671c9f-612d-440d-a3c6-67534a104edc None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:15:59.959374 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc671c9f-612d-440d-a3c6-67534a104edc None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:15:59.959652 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc671c9f-612d-440d-a3c6-67534a104edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:15:59.960479 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc671c9f-612d-440d-a3c6-67534a104edc None admin] RBAC: Adding query filter params (group.id=37ec2266107f467c991bdbdd77290fa6, role.id=3ce491f94839419ea9ba3b84324fcd8f, scope.project.id=eab201cd44aa434290a1342e2a40c316) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:15:59.960791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc671c9f-612d-440d-a3c6-67534a104edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:15:59.962222 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc671c9f-612d-440d-a3c6-67534a104edc None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:15:59.968207 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 212/449] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/role_assignments?group.id=37ec2266107f467c991bdbdd77290fa6&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=3ce491f94839419ea9ba3b84324fcd8f => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:15:59.968689 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd798fd-e559-45af-a743-c8a084b52026 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:15:59.968988 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc671c9f-612d-440d-a3c6-67534a104edc None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:15:59.977583 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:00.016793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0a89-a22f-4058-97cf-9fb43e1fc4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:00.017673 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0a89-a22f-4058-97cf-9fb43e1fc4bf None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:00.017959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0a89-a22f-4058-97cf-9fb43e1fc4bf None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:00.018266 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0a89-a22f-4058-97cf-9fb43e1fc4bf None admin] PATH_INFO: `/v3/projects/eab201cd44aa434290a1342e2a40c316` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:00.019500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab0a89-a22f-4058-97cf-9fb43e1fc4bf None admin] RBAC: Authorizing `identity:get_project(project_id=eab201cd44aa434290a1342e2a40c316)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:00.021098 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab0a89-a22f-4058-97cf-9fb43e1fc4bf None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:00.027459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 238/450] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/projects/eab201cd44aa434290a1342e2a40c316 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:00.028596 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0a89-a22f-4058-97cf-9fb43e1fc4bf None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:00.082654 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc671c9f-612d-440d-a3c6-67534a104edc None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:00.111077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:00.129327 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b331c9-3ddc-4208-b6b6-680e41841354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:00.129327 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b331c9-3ddc-4208-b6b6-680e41841354 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:00.129327 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b331c9-3ddc-4208-b6b6-680e41841354 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:00.129327 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b331c9-3ddc-4208-b6b6-680e41841354 None admin] PATH_INFO: `/v3/projects/47e2c6597d274fcc88b12f356f1b2eb0` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:00.129986 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b331c9-3ddc-4208-b6b6-680e41841354 None admin] RBAC: Authorizing `identity:get_project(project_id=47e2c6597d274fcc88b12f356f1b2eb0)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:00.129986 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b331c9-3ddc-4208-b6b6-680e41841354 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:00.135492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 213/451] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Jun 2 14:15:59 2022] GET /identity/v3/projects/47e2c6597d274fcc88b12f356f1b2eb0 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:00.136771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b331c9-3ddc-4208-b6b6-680e41841354 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:00.154868 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0a89-a22f-4058-97cf-9fb43e1fc4bf None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:00.205122 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c913d-5de6-41ba-b045-fc5ee0621fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:00.206159 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c913d-5de6-41ba-b045-fc5ee0621fca None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:00.206566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c913d-5de6-41ba-b045-fc5ee0621fca None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:00.206873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c913d-5de6-41ba-b045-fc5ee0621fca None admin] PATH_INFO: `/v3/groups/37ec2266107f467c991bdbdd77290fa6` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:00.208551 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c913d-5de6-41ba-b045-fc5ee0621fca None admin] RBAC: Authorizing `identity:get_group(group_id=37ec2266107f467c991bdbdd77290fa6)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:00.210515 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c913d-5de6-41ba-b045-fc5ee0621fca None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:00.212830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 239/452] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:16:00 2022] GET /identity/v3/groups/37ec2266107f467c991bdbdd77290fa6 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:00.219420 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c913d-5de6-41ba-b045-fc5ee0621fca None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:00.234848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:00.259857 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b331c9-3ddc-4208-b6b6-680e41841354 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:00.306707 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9825a08-53be-4b4d-86be-c056e6c93dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:00.307824 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9825a08-53be-4b4d-86be-c056e6c93dc4 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:00.308109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9825a08-53be-4b4d-86be-c056e6c93dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:00.308387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9825a08-53be-4b4d-86be-c056e6c93dc4 None admin] PATH_INFO: `/v3/groups/24522e4c591543f58a2c3465041a954c` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:00.310161 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9825a08-53be-4b4d-86be-c056e6c93dc4 None admin] RBAC: Authorizing `identity:get_group(group_id=24522e4c591543f58a2c3465041a954c)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:00.312019 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9825a08-53be-4b4d-86be-c056e6c93dc4 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:00.313566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 214/453] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Jun 2 14:16:00 2022] GET /identity/v3/groups/24522e4c591543f58a2c3465041a954c => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:00.320449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9825a08-53be-4b4d-86be-c056e6c93dc4 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:00.348729 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c913d-5de6-41ba-b045-fc5ee0621fca None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:00.391956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc07de9-67b6-4f57-8610-f2b39380ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:00.392574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc07de9-67b6-4f57-8610-f2b39380ec15 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:00.392877 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc07de9-67b6-4f57-8610-f2b39380ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:00.393099 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc07de9-67b6-4f57-8610-f2b39380ec15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:00.393940 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc07de9-67b6-4f57-8610-f2b39380ec15 None admin] RBAC: Adding query filter params (group.id=37ec2266107f467c991bdbdd77290fa6, role.id=5782703fc53f48f28fb7015ae693cd60, scope.project.id=eab201cd44aa434290a1342e2a40c316) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:00.394258 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc07de9-67b6-4f57-8610-f2b39380ec15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:00.395780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc07de9-67b6-4f57-8610-f2b39380ec15 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:00.401881 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 240/454] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 14:16:00 2022] GET /identity/v3/role_assignments?group.id=37ec2266107f467c991bdbdd77290fa6&scope.project.id=eab201cd44aa434290a1342e2a40c316&role.id=5782703fc53f48f28fb7015ae693cd60 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:00.433899 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9825a08-53be-4b4d-86be-c056e6c93dc4 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:00.472087 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ab0c-1c3d-4e2c-a7a3-d51ec34df3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:00.472768 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ab0c-1c3d-4e2c-a7a3-d51ec34df3cf None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:00.473051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ab0c-1c3d-4e2c-a7a3-d51ec34df3cf None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:00.473331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ab0c-1c3d-4e2c-a7a3-d51ec34df3cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:00.474172 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60ab0c-1c3d-4e2c-a7a3-d51ec34df3cf None admin] RBAC: Adding query filter params (group.id=24522e4c591543f58a2c3465041a954c, role.id=61482861f00e45048fc1d45570c4c99b, scope.project.id=47e2c6597d274fcc88b12f356f1b2eb0) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:00.474484 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60ab0c-1c3d-4e2c-a7a3-d51ec34df3cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:00.475996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60ab0c-1c3d-4e2c-a7a3-d51ec34df3cf None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:00.483271 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 215/455] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Jun 2 14:16:00 2022] GET /identity/v3/role_assignments?group.id=24522e4c591543f58a2c3465041a954c&scope.project.id=47e2c6597d274fcc88b12f356f1b2eb0&role.id=61482861f00e45048fc1d45570c4c99b => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:03.210200 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4267-35ee-4018-b702-0e011f0b8cbc None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.211368 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4267-35ee-4018-b702-0e011f0b8cbc None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.211868 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4267-35ee-4018-b702-0e011f0b8cbc None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.213883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 241/456] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:03.220753 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6650a9-22c9-466e-8deb-42d823676317 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.221697 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6650a9-22c9-466e-8deb-42d823676317 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.222228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6650a9-22c9-466e-8deb-42d823676317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.234727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:03.240620 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-cd6650a9-22c9-466e-8deb-42d823676317 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:03.241834 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-cd6650a9-22c9-466e-8deb-42d823676317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:03.313711 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 216/457] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:03.341390 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb4267-35ee-4018-b702-0e011f0b8cbc None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:03.346531 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:03.368666 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9291f3-83ea-41ed-b2de-8497284a1e0e None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.369237 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9291f3-83ea-41ed-b2de-8497284a1e0e None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.369757 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9291f3-83ea-41ed-b2de-8497284a1e0e None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.372270 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 217/458] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:03.380722 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8de1-f612-4375-8a62-f8df04d03f34 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.381300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8de1-f612-4375-8a62-f8df04d03f34 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.381780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8de1-f612-4375-8a62-f8df04d03f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.403030 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-ba6b8de1-f612-4375-8a62-f8df04d03f34 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:03.405063 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-ba6b8de1-f612-4375-8a62-f8df04d03f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:03.464794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb4267-35ee-4018-b702-0e011f0b8cbc None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:03.509070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41872866-e404-401b-8924-7775ff81b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:03.510100 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41872866-e404-401b-8924-7775ff81b53a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.510615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41872866-e404-401b-8924-7775ff81b53a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.511054 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41872866-e404-401b-8924-7775ff81b53a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.514709 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 218/459] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:03.528431 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41872866-e404-401b-8924-7775ff81b53a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:03.530153 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41872866-e404-401b-8924-7775ff81b53a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:03.539673 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b8de1-f612-4375-8a62-f8df04d03f34 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-41872866-e404-401b-8924-7775ff81b53a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:03.553873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:03.554826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:03.555697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:03.555697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:03.555697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:03.555697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:03.555697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 242/460] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:03.560969 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f85bc-565d-43ae-9a1f-4960db2f96bc None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.561458 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f85bc-565d-43ae-9a1f-4960db2f96bc None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.561748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f85bc-565d-43ae-9a1f-4960db2f96bc None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.563551 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 243/461] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:03.564125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f85bc-565d-43ae-9a1f-4960db2f96bc None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:03.611415 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:03.633162 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:03.648616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b8de1-f612-4375-8a62-f8df04d03f34 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:03.681219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f85bc-565d-43ae-9a1f-4960db2f96bc None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:03.688340 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b5454-d12d-4575-b98a-06cc99a628b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:03.689336 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5454-d12d-4575-b98a-06cc99a628b7 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.689688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5454-d12d-4575-b98a-06cc99a628b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.689971 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5454-d12d-4575-b98a-06cc99a628b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.701830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b5454-d12d-4575-b98a-06cc99a628b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:03.703513 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b5454-d12d-4575-b98a-06cc99a628b7 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:03.717119 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7dbb-b18c-420a-966b-f27545fb37c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:03.718874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7dbb-b18c-420a-966b-f27545fb37c4 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.718874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7dbb-b18c-420a-966b-f27545fb37c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.718874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7dbb-b18c-420a-966b-f27545fb37c4 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.719141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e7dbb-b18c-420a-966b-f27545fb37c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:03.719361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e7dbb-b18c-420a-966b-f27545fb37c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:03.720696 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e7dbb-b18c-420a-966b-f27545fb37c4 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-357b5454-d12d-4575-b98a-06cc99a628b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:03.723516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:03.724371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:03.730278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:03.730278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:03.730278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:03.730278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:03.730278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 219/462] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:03.730278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe85f8-9d85-4378-b394-50ce96d9bda2 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.730278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe85f8-9d85-4378-b394-50ce96d9bda2 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.730278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe85f8-9d85-4378-b394-50ce96d9bda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.742331 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 244/463] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:03.743246 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7dbb-b18c-420a-966b-f27545fb37c4 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:03.744662 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-11fe85f8-9d85-4378-b394-50ce96d9bda2 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:03.745992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-11fe85f8-9d85-4378-b394-50ce96d9bda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:03.819379 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 220/464] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:03.820632 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe85f8-9d85-4378-b394-50ce96d9bda2 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:03.846180 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7dbb-b18c-420a-966b-f27545fb37c4 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:03.863459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:03.868560 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:03.884913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de3630-8992-48c6-85a5-2d4ad84486cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:03.885581 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3630-8992-48c6-85a5-2d4ad84486cc None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.885871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3630-8992-48c6-85a5-2d4ad84486cc None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.886154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3630-8992-48c6-85a5-2d4ad84486cc None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.886921 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de3630-8992-48c6-85a5-2d4ad84486cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:03.887422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de3630-8992-48c6-85a5-2d4ad84486cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:03.888892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de3630-8992-48c6-85a5-2d4ad84486cc None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:03.901053 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 245/465] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:03.902338 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3954d-2876-49bf-af8c-385be91885fa None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.902676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3954d-2876-49bf-af8c-385be91885fa None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.902984 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3954d-2876-49bf-af8c-385be91885fa None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.904591 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 246/466] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:03.905132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3954d-2876-49bf-af8c-385be91885fa None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:03.924271 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe85f8-9d85-4378-b394-50ce96d9bda2 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:03.959616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a16f5-6f77-4d69-a111-118a0f5067ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:03.960288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a16f5-6f77-4d69-a111-118a0f5067ea None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:03.960577 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a16f5-6f77-4d69-a111-118a0f5067ea None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:03.960860 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a16f5-6f77-4d69-a111-118a0f5067ea None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:03.961597 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a16f5-6f77-4d69-a111-118a0f5067ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:03.963101 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a16f5-6f77-4d69-a111-118a0f5067ea None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:04.008278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3954d-2876-49bf-af8c-385be91885fa None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:04.042884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06648f-4ef3-41fd-98c1-f46b94c0139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:04.043899 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06648f-4ef3-41fd-98c1-f46b94c0139a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:04.044289 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06648f-4ef3-41fd-98c1-f46b94c0139a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:04.044571 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06648f-4ef3-41fd-98c1-f46b94c0139a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:04.054610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06648f-4ef3-41fd-98c1-f46b94c0139a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:04.056123 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06648f-4ef3-41fd-98c1-f46b94c0139a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-5f06648f-4ef3-41fd-98c1-f46b94c0139a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:04.073751 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:04.075943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:04.076778 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:04.076778 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:04.076778 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:04.076778 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:04.076778 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 247/467] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:04.077038 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06648f-4ef3-41fd-98c1-f46b94c0139a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:04.099145 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 221/468] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:16:03 2022] POST /identity/v3/users => generated 246 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:04.100541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a660f-7399-4e73-9934-6e8f983cb3bf None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:04.103859 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a660f-7399-4e73-9934-6e8f983cb3bf None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:04.103859 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a660f-7399-4e73-9934-6e8f983cb3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:04.106764 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:04.133142 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-9b9a660f-7399-4e73-9934-6e8f983cb3bf None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:04.134944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-9b9a660f-7399-4e73-9934-6e8f983cb3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:04.204794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06648f-4ef3-41fd-98c1-f46b94c0139a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:04.222669 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 222/469] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:04.222669 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a660f-7399-4e73-9934-6e8f983cb3bf None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:04.263018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48c9d-2e89-4062-b258-e25d5bdc2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:04.264255 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48c9d-2e89-4062-b258-e25d5bdc2a0d None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:04.264721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48c9d-2e89-4062-b258-e25d5bdc2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:04.265158 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48c9d-2e89-4062-b258-e25d5bdc2a0d None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:04.266603 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c48c9d-2e89-4062-b258-e25d5bdc2a0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:04.269609 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c48c9d-2e89-4062-b258-e25d5bdc2a0d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:04.270917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:04.343204 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a660f-7399-4e73-9934-6e8f983cb3bf None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:04.357998 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 248/470] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:16:04 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:04.358970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48c9d-2e89-4062-b258-e25d5bdc2a0d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:04.382283 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f140-2367-461c-b461-3e19c58bcdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:04.383009 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f140-2367-461c-b461-3e19c58bcdd2 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:04.383293 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f140-2367-461c-b461-3e19c58bcdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:04.383570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f140-2367-461c-b461-3e19c58bcdd2 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:04.384317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f140-2367-461c-b461-3e19c58bcdd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:04.384627 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f140-2367-461c-b461-3e19c58bcdd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:04.386937 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f140-2367-461c-b461-3e19c58bcdd2 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:04.406100 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 223/471] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:04.407354 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f140-2367-461c-b461-3e19c58bcdd2 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:04.479655 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:04.498600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48c9d-2e89-4062-b258-e25d5bdc2a0d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:04.541722 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948afbca-4633-46d0-9ff3-3429983148a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:04.542585 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948afbca-4633-46d0-9ff3-3429983148a3 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:04.543031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948afbca-4633-46d0-9ff3-3429983148a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:04.544021 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948afbca-4633-46d0-9ff3-3429983148a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:04.556521 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948afbca-4633-46d0-9ff3-3429983148a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:04.558764 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948afbca-4633-46d0-9ff3-3429983148a3 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:04.563264 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:04.576502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f140-2367-461c-b461-3e19c58bcdd2 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-948afbca-4633-46d0-9ff3-3429983148a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:04.586235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:04.587171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:04.588006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:04.588006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:04.588006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:04.588006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:04.591070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 249/472] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:04.593682 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948afbca-4633-46d0-9ff3-3429983148a3 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:04.617401 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe66c-0793-421f-bd74-42b377d47d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:04.618085 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe66c-0793-421f-bd74-42b377d47d1d None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:04.618368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe66c-0793-421f-bd74-42b377d47d1d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:04.620578 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe66c-0793-421f-bd74-42b377d47d1d None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:04.620578 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe66c-0793-421f-bd74-42b377d47d1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:04.621877 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe66c-0793-421f-bd74-42b377d47d1d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:04.705977 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948afbca-4633-46d0-9ff3-3429983148a3 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:04.741084 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e359a21-d69f-4585-b037-9dd4904bee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:04.741753 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e359a21-d69f-4585-b037-9dd4904bee63 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:04.742037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e359a21-d69f-4585-b037-9dd4904bee63 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:04.742314 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e359a21-d69f-4585-b037-9dd4904bee63 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:04.743075 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e359a21-d69f-4585-b037-9dd4904bee63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:04.743471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e359a21-d69f-4585-b037-9dd4904bee63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:04.749281 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e359a21-d69f-4585-b037-9dd4904bee63 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:04.749281 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:04.758261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 250/473] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:04.763821 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 224/474] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:16:04 2022] POST /identity/v3/users => generated 248 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:16:04.764485 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e359a21-d69f-4585-b037-9dd4904bee63 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:04.889809 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e359a21-d69f-4585-b037-9dd4904bee63 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:04.929829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f0983-c050-40ab-afa3-44eb336f1f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:04.930527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f0983-c050-40ab-afa3-44eb336f1f40 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:04.930850 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f0983-c050-40ab-afa3-44eb336f1f40 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:04.931131 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f0983-c050-40ab-afa3-44eb336f1f40 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:04.931999 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f0983-c050-40ab-afa3-44eb336f1f40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:04.933546 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f0983-c050-40ab-afa3-44eb336f1f40 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:05.028284 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 251/475] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:16:04 2022] POST /identity/v3/users => generated 249 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:16:06.582542 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf4035-f38a-4a12-9de4-73a59c445eb7 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:06.583082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf4035-f38a-4a12-9de4-73a59c445eb7 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:06.583187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf4035-f38a-4a12-9de4-73a59c445eb7 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:06.584639 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 225/476] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:06.590723 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fe773-eeed-4a39-a1db-eeef54f17aae None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:06.591520 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fe773-eeed-4a39-a1db-eeef54f17aae None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:06.591991 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fe773-eeed-4a39-a1db-eeef54f17aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:06.610030 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-9a2fe773-eeed-4a39-a1db-eeef54f17aae None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:06.611290 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-9a2fe773-eeed-4a39-a1db-eeef54f17aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:06.662797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:06.684445 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 252/477] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:06.709717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf4035-f38a-4a12-9de4-73a59c445eb7 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:06.825131 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf4035-f38a-4a12-9de4-73a59c445eb7 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:06.865702 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b1970-b675-4317-96b4-1bb8b14ec88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:06.866916 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b1970-b675-4317-96b4-1bb8b14ec88e None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:06.867395 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b1970-b675-4317-96b4-1bb8b14ec88e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:06.867862 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b1970-b675-4317-96b4-1bb8b14ec88e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:06.887766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b1970-b675-4317-96b4-1bb8b14ec88e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-2a0b1970-b675-4317-96b4-1bb8b14ec88e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:06.901408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:06.902333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:06.903765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:06.904347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efd64-3c12-4269-bde3-3364b606fbae None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:06.904347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efd64-3c12-4269-bde3-3364b606fbae None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:06.904347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4efd64-3c12-4269-bde3-3364b606fbae None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:06.905800 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 253/478] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:06.909479 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 226/479] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:06.910932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1691-39cd-458a-b36b-1594ecc6be89 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:06.911225 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1691-39cd-458a-b36b-1594ecc6be89 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:06.911509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1691-39cd-458a-b36b-1594ecc6be89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:06.913491 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b1970-b675-4317-96b4-1bb8b14ec88e None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:06.929905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-3b1d1691-39cd-458a-b36b-1594ecc6be89 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:06.931079 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:06.932674 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-3b1d1691-39cd-458a-b36b-1594ecc6be89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:07.025193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 254/480] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:16:07.029095 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b1970-b675-4317-96b4-1bb8b14ec88e None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:07.045939 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1691-39cd-458a-b36b-1594ecc6be89 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:07.070935 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d39cc-3be3-4f63-ac42-8333c13bdd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:07.071645 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d39cc-3be3-4f63-ac42-8333c13bdd83 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.071932 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d39cc-3be3-4f63-ac42-8333c13bdd83 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.072210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d39cc-3be3-4f63-ac42-8333c13bdd83 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.072988 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d39cc-3be3-4f63-ac42-8333c13bdd83 None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:07.073395 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d39cc-3be3-4f63-ac42-8333c13bdd83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:07.074945 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d39cc-3be3-4f63-ac42-8333c13bdd83 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:07.089442 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 227/481] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:07.091651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d39cc-3be3-4f63-ac42-8333c13bdd83 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:07.253529 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1691-39cd-458a-b36b-1594ecc6be89 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:07.266531 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:07.268934 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:07.293899 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a249c-9205-4df0-a1be-f2e628cc283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:07.294724 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a249c-9205-4df0-a1be-f2e628cc283b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.295018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a249c-9205-4df0-a1be-f2e628cc283b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.295292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a249c-9205-4df0-a1be-f2e628cc283b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.300194 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d39cc-3be3-4f63-ac42-8333c13bdd83 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:07.305773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a249c-9205-4df0-a1be-f2e628cc283b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-5c2a249c-9205-4df0-a1be-f2e628cc283b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:07.313739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:07.314837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:07.315842 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 255/482] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:07.316537 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176ba4-855b-455c-ad0f-c2c34ac8f090 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.316826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176ba4-855b-455c-ad0f-c2c34ac8f090 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.317107 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176ba4-855b-455c-ad0f-c2c34ac8f090 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.318697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 256/483] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:07.323251 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1176ba4-855b-455c-ad0f-c2c34ac8f090 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:07.351513 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f954102-1e81-4dc2-93e4-e543dcd6c054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:07.352481 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f954102-1e81-4dc2-93e4-e543dcd6c054 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.352826 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f954102-1e81-4dc2-93e4-e543dcd6c054 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.353167 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f954102-1e81-4dc2-93e4-e543dcd6c054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.365608 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f954102-1e81-4dc2-93e4-e543dcd6c054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:07.367243 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f954102-1e81-4dc2-93e4-e543dcd6c054 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-0f954102-1e81-4dc2-93e4-e543dcd6c054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:07.386997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:07.388165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:07.389048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:07.389048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:07.389048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:07.389048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:07.389048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 228/484] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:07.389982 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd18989-6c59-427e-aff0-9e3d02894d25 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.390323 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd18989-6c59-427e-aff0-9e3d02894d25 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.390604 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd18989-6c59-427e-aff0-9e3d02894d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.408097 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-8fd18989-6c59-427e-aff0-9e3d02894d25 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:07.409291 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-8fd18989-6c59-427e-aff0-9e3d02894d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:07.437777 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1176ba4-855b-455c-ad0f-c2c34ac8f090 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:07.471771 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c322-ef10-4f12-9107-5ba322dd12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:07.472429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c322-ef10-4f12-9107-5ba322dd12fa None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.472709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c322-ef10-4f12-9107-5ba322dd12fa None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.472990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c322-ef10-4f12-9107-5ba322dd12fa None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.473730 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c322-ef10-4f12-9107-5ba322dd12fa None admin] RBAC: Adding query filter params (name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:07.474034 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c322-ef10-4f12-9107-5ba322dd12fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:07.475443 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c322-ef10-4f12-9107-5ba322dd12fa None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:07.477189 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 229/485] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:07.478044 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd18989-6c59-427e-aff0-9e3d02894d25 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:07.484063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 257/486] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:07.485346 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cd6d4-912c-4a18-9b6e-f376d85b434a None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.485638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cd6d4-912c-4a18-9b6e-f376d85b434a None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.485918 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cd6d4-912c-4a18-9b6e-f376d85b434a None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.489256 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 258/487] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:07.489256 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cd6d4-912c-4a18-9b6e-f376d85b434a None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:07.525402 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:07.543097 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:07.586610 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd18989-6c59-427e-aff0-9e3d02894d25 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:07.593092 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cd6d4-912c-4a18-9b6e-f376d85b434a None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:07.620613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34767a-8811-4494-ae8e-79b2d537402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:07.621276 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34767a-8811-4494-ae8e-79b2d537402d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.621663 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34767a-8811-4494-ae8e-79b2d537402d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.621938 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34767a-8811-4494-ae8e-79b2d537402d None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.622690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34767a-8811-4494-ae8e-79b2d537402d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:07.623002 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34767a-8811-4494-ae8e-79b2d537402d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:07.624380 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34767a-8811-4494-ae8e-79b2d537402d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:07.625865 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89396-0ebe-4435-b04c-550875d8479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:07.626651 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89396-0ebe-4435-b04c-550875d8479c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.627096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89396-0ebe-4435-b04c-550875d8479c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.627373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89396-0ebe-4435-b04c-550875d8479c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.635551 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 230/488] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:07.636737 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0435684-3967-41b5-8bbb-7e75c79befb2 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.637574 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0435684-3967-41b5-8bbb-7e75c79befb2 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.637807 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0435684-3967-41b5-8bbb-7e75c79befb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.642726 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e89396-0ebe-4435-b04c-550875d8479c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:07.644182 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e89396-0ebe-4435-b04c-550875d8479c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:07.654006 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-f0435684-3967-41b5-8bbb-7e75c79befb2 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:07.655218 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-f0435684-3967-41b5-8bbb-7e75c79befb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-50e89396-0ebe-4435-b04c-550875d8479c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:07.662070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:07.663111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:07.664006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:07.664006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:07.664006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:07.664006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:07.664006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 259/489] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:07.664280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89396-0ebe-4435-b04c-550875d8479c None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:07.724623 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 231/490] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:07.725580 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0435684-3967-41b5-8bbb-7e75c79befb2 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:07.749252 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:07.764096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89396-0ebe-4435-b04c-550875d8479c None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:07.787042 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:07.798808 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d66973-762d-4cfb-9b7d-99fa0122d990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:07.799610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d66973-762d-4cfb-9b7d-99fa0122d990 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.799896 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d66973-762d-4cfb-9b7d-99fa0122d990 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.800173 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d66973-762d-4cfb-9b7d-99fa0122d990 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.810275 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d66973-762d-4cfb-9b7d-99fa0122d990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-09d66973-762d-4cfb-9b7d-99fa0122d990 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:07.818000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:07.819146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:07.819960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 260/491] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:07.820626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d66973-762d-4cfb-9b7d-99fa0122d990 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:07.846498 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0435684-3967-41b5-8bbb-7e75c79befb2 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:07.880295 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99662633-1435-4704-adc9-5ef632ec0d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:07.881088 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99662633-1435-4704-adc9-5ef632ec0d69 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.881368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99662633-1435-4704-adc9-5ef632ec0d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.881638 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99662633-1435-4704-adc9-5ef632ec0d69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.889569 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99662633-1435-4704-adc9-5ef632ec0d69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:07.891101 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99662633-1435-4704-adc9-5ef632ec0d69 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-99662633-1435-4704-adc9-5ef632ec0d69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:07.907792 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:07.908875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 232/492] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 14:16:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:07.909875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99662633-1435-4704-adc9-5ef632ec0d69 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:07.926599 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d66973-762d-4cfb-9b7d-99fa0122d990 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:07.960566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a15d-b234-462c-8c02-1b0959d98b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:07.961222 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a15d-b234-462c-8c02-1b0959d98b50 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:07.961504 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a15d-b234-462c-8c02-1b0959d98b50 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:07.961779 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27a15d-b234-462c-8c02-1b0959d98b50 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:07.962500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a15d-b234-462c-8c02-1b0959d98b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:07.962841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a15d-b234-462c-8c02-1b0959d98b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:07.964227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27a15d-b234-462c-8c02-1b0959d98b50 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:07.976668 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 261/493] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:07.977467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a15d-b234-462c-8c02-1b0959d98b50 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:07.986328 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:08.021855 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99662633-1435-4704-adc9-5ef632ec0d69 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.024224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:08.056796 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c3647-8b59-43d0-8dbd-d4b48e3a7a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.057518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c3647-8b59-43d0-8dbd-d4b48e3a7a8b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.057803 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c3647-8b59-43d0-8dbd-d4b48e3a7a8b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.058079 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c3647-8b59-43d0-8dbd-d4b48e3a7a8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.068251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c3647-8b59-43d0-8dbd-d4b48e3a7a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-6c6c3647-8b59-43d0-8dbd-d4b48e3a7a8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:08.076351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:08.077220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:08.077996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:08.079060 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27a15d-b234-462c-8c02-1b0959d98b50 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.079134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 233/494] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:08.079134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c3647-8b59-43d0-8dbd-d4b48e3a7a8b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:08.115137 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbdbbf-8640-4424-93cc-9f91f762c3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.115788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbdbbf-8640-4424-93cc-9f91f762c3e7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.116069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbdbbf-8640-4424-93cc-9f91f762c3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.116393 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbdbbf-8640-4424-93cc-9f91f762c3e7 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.117136 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbdbbf-8640-4424-93cc-9f91f762c3e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:08.117440 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbdbbf-8640-4424-93cc-9f91f762c3e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:08.118855 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbdbbf-8640-4424-93cc-9f91f762c3e7 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:08.127065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 262/495] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:08.127846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbdbbf-8640-4424-93cc-9f91f762c3e7 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:08.179710 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c3647-8b59-43d0-8dbd-d4b48e3a7a8b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.196214 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:08.212931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a810-45ea-4a1f-9e7e-a51ef374b37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.213596 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a810-45ea-4a1f-9e7e-a51ef374b37c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.213876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a810-45ea-4a1f-9e7e-a51ef374b37c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.214150 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a810-45ea-4a1f-9e7e-a51ef374b37c None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.215642 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7a810-45ea-4a1f-9e7e-a51ef374b37c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:08.215955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7a810-45ea-4a1f-9e7e-a51ef374b37c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:08.217400 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7a810-45ea-4a1f-9e7e-a51ef374b37c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:08.229657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbdbbf-8640-4424-93cc-9f91f762c3e7 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.257833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 234/496] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 14:16:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:08.257833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a810-45ea-4a1f-9e7e-a51ef374b37c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:08.263799 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbfabc-f767-4dde-a0bf-cb91d2ace288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.264610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbfabc-f767-4dde-a0bf-cb91d2ace288 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.264967 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbfabc-f767-4dde-a0bf-cb91d2ace288 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.265318 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbfabc-f767-4dde-a0bf-cb91d2ace288 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.273090 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbfabc-f767-4dde-a0bf-cb91d2ace288 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:08.274536 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbfabc-f767-4dde-a0bf-cb91d2ace288 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:08.278882 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-cafbfabc-f767-4dde-a0bf-cb91d2ace288 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:08.291329 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:08.292261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:08.293175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 263/497] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:16:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:08.293735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbfabc-f767-4dde-a0bf-cb91d2ace288 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:08.359137 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a810-45ea-4a1f-9e7e-a51ef374b37c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.393009 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f10581-6402-4275-b3c9-b2ba3217cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.393675 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f10581-6402-4275-b3c9-b2ba3217cc71 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.393961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f10581-6402-4275-b3c9-b2ba3217cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.394242 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f10581-6402-4275-b3c9-b2ba3217cc71 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.394827 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbfabc-f767-4dde-a0bf-cb91d2ace288 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.395022 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f10581-6402-4275-b3c9-b2ba3217cc71 None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:08.395335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f10581-6402-4275-b3c9-b2ba3217cc71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:08.396737 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f10581-6402-4275-b3c9-b2ba3217cc71 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:08.405082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 235/498] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:08.405879 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f10581-6402-4275-b3c9-b2ba3217cc71 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:08.425761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:08.433348 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626a80c-2b4c-4805-acf3-a58691acb0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.434377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626a80c-2b4c-4805-acf3-a58691acb0bb None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.434817 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626a80c-2b4c-4805-acf3-a58691acb0bb None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.435111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626a80c-2b4c-4805-acf3-a58691acb0bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.446423 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626a80c-2b4c-4805-acf3-a58691acb0bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:08.447965 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626a80c-2b4c-4805-acf3-a58691acb0bb None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-4626a80c-2b4c-4805-acf3-a58691acb0bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:08.466781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:08.467813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:08.468836 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:08.468836 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:08.468836 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:08.468836 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:08.470874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 264/499] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:08.471887 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626a80c-2b4c-4805-acf3-a58691acb0bb None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:08.491757 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:08.508752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f10581-6402-4275-b3c9-b2ba3217cc71 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.543341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d69c4-61f7-4402-b9e8-1567e231420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.544062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d69c4-61f7-4402-b9e8-1567e231420c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.544341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d69c4-61f7-4402-b9e8-1567e231420c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.544615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d69c4-61f7-4402-b9e8-1567e231420c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.572345 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626a80c-2b4c-4805-acf3-a58691acb0bb None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.606528 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd0b69-3642-4200-8221-c1786901921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.607233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd0b69-3642-4200-8221-c1786901921e None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.607520 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd0b69-3642-4200-8221-c1786901921e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.607796 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd0b69-3642-4200-8221-c1786901921e None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.608631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd0b69-3642-4200-8221-c1786901921e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:08.608944 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd0b69-3642-4200-8221-c1786901921e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:08.610451 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd0b69-3642-4200-8221-c1786901921e None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:08.612039 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d69c4-61f7-4402-b9e8-1567e231420c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:08.613635 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d69c4-61f7-4402-b9e8-1567e231420c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:08.647565 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 265/500] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 14:16:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:08.647565 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd0b69-3642-4200-8221-c1786901921e None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:08.690775 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:08.699178 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:08.716694 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 236/501] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:16:08.717510 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d69c4-61f7-4402-b9e8-1567e231420c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:08.751871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd0b69-3642-4200-8221-c1786901921e None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.786542 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85613500-0243-483f-877d-db96e00d8381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.787371 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85613500-0243-483f-877d-db96e00d8381 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.787661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85613500-0243-483f-877d-db96e00d8381 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.787945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85613500-0243-483f-877d-db96e00d8381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.798869 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85613500-0243-483f-877d-db96e00d8381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:08.800388 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85613500-0243-483f-877d-db96e00d8381 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:08.817038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d69c4-61f7-4402-b9e8-1567e231420c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-85613500-0243-483f-877d-db96e00d8381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:08.818154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:08.819069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:08.819925 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:08.819925 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:08.819925 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:08.819925 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:08.819925 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 266/502] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:08.820211 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85613500-0243-483f-877d-db96e00d8381 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:08.851944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe413-206a-4f96-a885-3ddfcc43b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.852662 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe413-206a-4f96-a885-3ddfcc43b065 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.852954 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe413-206a-4f96-a885-3ddfcc43b065 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.853224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fe413-206a-4f96-a885-3ddfcc43b065 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.853943 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fe413-206a-4f96-a885-3ddfcc43b065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:08.854254 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fe413-206a-4f96-a885-3ddfcc43b065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:08.855701 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fe413-206a-4f96-a885-3ddfcc43b065 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:08.867743 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 237/503] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:08.871563 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe413-206a-4f96-a885-3ddfcc43b065 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:08.914902 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:08.919364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:08.924559 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85613500-0243-483f-877d-db96e00d8381 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:08.957640 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3f13a-98f6-4bff-99de-c22522e95956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:08.958292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3f13a-98f6-4bff-99de-c22522e95956 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:08.958606 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3f13a-98f6-4bff-99de-c22522e95956 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:08.958916 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3f13a-98f6-4bff-99de-c22522e95956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:08.972734 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fe413-206a-4f96-a885-3ddfcc43b065 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:09.006590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21737cd2-cf51-4ad6-a70a-3a7a40c3f9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:09.007399 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21737cd2-cf51-4ad6-a70a-3a7a40c3f9d6 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:09.007681 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21737cd2-cf51-4ad6-a70a-3a7a40c3f9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:09.007954 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21737cd2-cf51-4ad6-a70a-3a7a40c3f9d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:09.019093 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21737cd2-cf51-4ad6-a70a-3a7a40c3f9d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.020543 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21737cd2-cf51-4ad6-a70a-3a7a40c3f9d6 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.029483 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3f13a-98f6-4bff-99de-c22522e95956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.030999 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3f13a-98f6-4bff-99de-c22522e95956 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-21737cd2-cf51-4ad6-a70a-3a7a40c3f9d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:09.038089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:09.038973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:09.039833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:09.039833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:09.039833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:09.039833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:09.039833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 238/504] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:09.040100 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21737cd2-cf51-4ad6-a70a-3a7a40c3f9d6 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.135986 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:09.142584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21737cd2-cf51-4ad6-a70a-3a7a40c3f9d6 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:09.178511 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b5789-7b5e-4c43-bab7-370ba56abc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:09.179219 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5789-7b5e-4c43-bab7-370ba56abc35 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:09.179500 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5789-7b5e-4c43-bab7-370ba56abc35 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:09.179774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5789-7b5e-4c43-bab7-370ba56abc35 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:09.180508 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b5789-7b5e-4c43-bab7-370ba56abc35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:09.180818 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b5789-7b5e-4c43-bab7-370ba56abc35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.182250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b5789-7b5e-4c43-bab7-370ba56abc35 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.195177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 239/505] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:09.196046 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b5789-7b5e-4c43-bab7-370ba56abc35 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.248566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:09.259222 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 267/506] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:16:09.260092 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3f13a-98f6-4bff-99de-c22522e95956 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.302549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b5789-7b5e-4c43-bab7-370ba56abc35 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:09.338834 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0060-0c7f-45c9-9a0f-0c36bd66e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:09.339620 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0060-0c7f-45c9-9a0f-0c36bd66e395 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:09.339898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0060-0c7f-45c9-9a0f-0c36bd66e395 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:09.340739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0060-0c7f-45c9-9a0f-0c36bd66e395 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:09.347923 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e0060-0c7f-45c9-9a0f-0c36bd66e395 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.349521 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e0060-0c7f-45c9-9a0f-0c36bd66e395 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.360240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3f13a-98f6-4bff-99de-c22522e95956 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-d53e0060-0c7f-45c9-9a0f-0c36bd66e395 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:09.363825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:09.364874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:09.365881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 240/507] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:09.366535 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0060-0c7f-45c9-9a0f-0c36bd66e395 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.383998 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:09.399135 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32e130-5cfe-45e4-a5ec-5cd545f4a758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:09.399135 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e130-5cfe-45e4-a5ec-5cd545f4a758 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:09.399135 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e130-5cfe-45e4-a5ec-5cd545f4a758 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:09.399135 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e130-5cfe-45e4-a5ec-5cd545f4a758 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:09.399759 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32e130-5cfe-45e4-a5ec-5cd545f4a758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:09.400083 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32e130-5cfe-45e4-a5ec-5cd545f4a758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.401468 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32e130-5cfe-45e4-a5ec-5cd545f4a758 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.413207 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 268/508] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:09.414029 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32e130-5cfe-45e4-a5ec-5cd545f4a758 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.468343 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:09.470390 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0060-0c7f-45c9-9a0f-0c36bd66e395 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:09.505425 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9129bf-c84d-4ecc-90e1-50d71350a114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:09.506222 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9129bf-c84d-4ecc-90e1-50d71350a114 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:09.506499 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9129bf-c84d-4ecc-90e1-50d71350a114 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:09.506802 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9129bf-c84d-4ecc-90e1-50d71350a114 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:09.514712 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9129bf-c84d-4ecc-90e1-50d71350a114 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.516163 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9129bf-c84d-4ecc-90e1-50d71350a114 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.518434 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32e130-5cfe-45e4-a5ec-5cd545f4a758 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-dd9129bf-c84d-4ecc-90e1-50d71350a114 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:09.531190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:09.532331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 241/509] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:09.533411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9129bf-c84d-4ecc-90e1-50d71350a114 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.554658 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822540e-7691-44b0-9429-ed408ad9f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:09.555461 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822540e-7691-44b0-9429-ed408ad9f1fd None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:09.555749 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822540e-7691-44b0-9429-ed408ad9f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:09.556025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822540e-7691-44b0-9429-ed408ad9f1fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:09.566768 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822540e-7691-44b0-9429-ed408ad9f1fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.568224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822540e-7691-44b0-9429-ed408ad9f1fd None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-f822540e-7691-44b0-9429-ed408ad9f1fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:09.586233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:09.587312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:09.588358 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:09.588358 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:09.588358 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:09.588358 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:09.588358 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 269/510] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:09.588358 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822540e-7691-44b0-9429-ed408ad9f1fd None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.613676 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:09.638702 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9129bf-c84d-4ecc-90e1-50d71350a114 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:09.672434 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0834a87-1a66-4e5f-a046-091e0557f5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:09.673032 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0834a87-1a66-4e5f-a046-091e0557f5b6 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:09.673314 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0834a87-1a66-4e5f-a046-091e0557f5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:09.673587 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0834a87-1a66-4e5f-a046-091e0557f5b6 None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:09.674416 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0834a87-1a66-4e5f-a046-091e0557f5b6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:09.674768 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0834a87-1a66-4e5f-a046-091e0557f5b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.676213 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0834a87-1a66-4e5f-a046-091e0557f5b6 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.692783 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822540e-7691-44b0-9429-ed408ad9f1fd None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:09.693613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 242/511] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:09.694269 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:09.694422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0834a87-1a66-4e5f-a046-091e0557f5b6 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.732722 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f02f2-755e-40f2-b9b9-10399f4d62f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:09.733511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f02f2-755e-40f2-b9b9-10399f4d62f4 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:09.733792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f02f2-755e-40f2-b9b9-10399f4d62f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:09.734065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f02f2-755e-40f2-b9b9-10399f4d62f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:09.741111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f02f2-755e-40f2-b9b9-10399f4d62f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.743139 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f02f2-755e-40f2-b9b9-10399f4d62f4 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-826f02f2-755e-40f2-b9b9-10399f4d62f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:09.758117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:09.759208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:09.760226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:09.760226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:09.760226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:09.760226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:09.760226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:09.760226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:09.760226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:09.760226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:09.760226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 270/512] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:09.760226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f02f2-755e-40f2-b9b9-10399f4d62f4 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.798569 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0834a87-1a66-4e5f-a046-091e0557f5b6 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:09.834154 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89d6eb-8e1b-49c6-9311-ae3d06fc321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:09.834858 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89d6eb-8e1b-49c6-9311-ae3d06fc321d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:09.835149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89d6eb-8e1b-49c6-9311-ae3d06fc321d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:09.835427 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89d6eb-8e1b-49c6-9311-ae3d06fc321d None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:09.836268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89d6eb-8e1b-49c6-9311-ae3d06fc321d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:09.836581 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89d6eb-8e1b-49c6-9311-ae3d06fc321d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.838054 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89d6eb-8e1b-49c6-9311-ae3d06fc321d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.839762 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:09.856934 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 243/513] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:09.857826 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89d6eb-8e1b-49c6-9311-ae3d06fc321d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.867147 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f02f2-755e-40f2-b9b9-10399f4d62f4 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:09.905054 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc6194-7c4f-4b95-b791-8f2452030b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:09.905729 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6194-7c4f-4b95-b791-8f2452030b56 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:09.906013 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6194-7c4f-4b95-b791-8f2452030b56 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:09.906289 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6194-7c4f-4b95-b791-8f2452030b56 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:09.907693 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc6194-7c4f-4b95-b791-8f2452030b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:09.908002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc6194-7c4f-4b95-b791-8f2452030b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:09.909446 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc6194-7c4f-4b95-b791-8f2452030b56 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:09.922722 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 271/514] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:09.923558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc6194-7c4f-4b95-b791-8f2452030b56 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:09.947185 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:09.966856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89d6eb-8e1b-49c6-9311-ae3d06fc321d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:10.001404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342c1d5-d747-4159-bcaa-030661bc1b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:10.002128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342c1d5-d747-4159-bcaa-030661bc1b02 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:10.002404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342c1d5-d747-4159-bcaa-030661bc1b02 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:10.002706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342c1d5-d747-4159-bcaa-030661bc1b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:10.022311 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc6194-7c4f-4b95-b791-8f2452030b56 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:10.055706 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5822f7-058f-42d1-a61c-cbdc726842f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:10.056357 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5822f7-058f-42d1-a61c-cbdc726842f9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:10.056642 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5822f7-058f-42d1-a61c-cbdc726842f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:10.056924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5822f7-058f-42d1-a61c-cbdc726842f9 None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:10.057707 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5822f7-058f-42d1-a61c-cbdc726842f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:10.058017 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5822f7-058f-42d1-a61c-cbdc726842f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:10.059580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5822f7-058f-42d1-a61c-cbdc726842f9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:10.061109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:10.070424 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342c1d5-d747-4159-bcaa-030661bc1b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:10.072001 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342c1d5-d747-4159-bcaa-030661bc1b02 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:10.077540 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 272/515] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:10.078371 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5822f7-058f-42d1-a61c-cbdc726842f9 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:10.161756 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:10.171865 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 244/516] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:16:10.174803 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342c1d5-d747-4159-bcaa-030661bc1b02 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:10.184698 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5822f7-058f-42d1-a61c-cbdc726842f9 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:10.220873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506c4ed-3211-46c1-84f0-430fd76ff279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:10.221517 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506c4ed-3211-46c1-84f0-430fd76ff279 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:10.221803 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506c4ed-3211-46c1-84f0-430fd76ff279 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:10.222083 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506c4ed-3211-46c1-84f0-430fd76ff279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:10.264155 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:10.273367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342c1d5-d747-4159-bcaa-030661bc1b02 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:10.291869 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506c4ed-3211-46c1-84f0-430fd76ff279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:10.294102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506c4ed-3211-46c1-84f0-430fd76ff279 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:10.307626 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c2f57-7f12-48e8-bce5-29a912c1f676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:10.308419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c2f57-7f12-48e8-bce5-29a912c1f676 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:10.308702 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c2f57-7f12-48e8-bce5-29a912c1f676 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:10.309079 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c2f57-7f12-48e8-bce5-29a912c1f676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:10.316236 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c2f57-7f12-48e8-bce5-29a912c1f676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:10.317697 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c2f57-7f12-48e8-bce5-29a912c1f676 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-b27c2f57-7f12-48e8-bce5-29a912c1f676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:10.332490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:10.333363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:10.334192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:10.334192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:10.334192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:10.334192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:10.334192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:10.334192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:10.334192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:10.334192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:10.334192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 245/517] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:10.334689 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c2f57-7f12-48e8-bce5-29a912c1f676 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:10.378804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:10.397119 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 273/518] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:16:10.398062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506c4ed-3211-46c1-84f0-430fd76ff279 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:10.435627 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c2f57-7f12-48e8-bce5-29a912c1f676 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:10.469837 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f18aee-a6f4-43dc-a1da-c736f474ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:10.470554 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18aee-a6f4-43dc-a1da-c736f474ac2b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:10.470865 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18aee-a6f4-43dc-a1da-c736f474ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:10.471144 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18aee-a6f4-43dc-a1da-c736f474ac2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:10.471961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f18aee-a6f4-43dc-a1da-c736f474ac2b None admin] RBAC: Adding query filter params (role.id=40519a26349f42bc93dc43425e96d7de, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=d9fa78e7e5be4bdcbd5c79a24895299d) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:10.472271 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f18aee-a6f4-43dc-a1da-c736f474ac2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:10.474146 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f18aee-a6f4-43dc-a1da-c736f474ac2b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:10.480356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 246/519] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:16:10 2022] GET /identity/v3/role_assignments?user.id=d9fa78e7e5be4bdcbd5c79a24895299d&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=40519a26349f42bc93dc43425e96d7de => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:10.482002 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f18aee-a6f4-43dc-a1da-c736f474ac2b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:10.502200 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:10.513914 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506c4ed-3211-46c1-84f0-430fd76ff279 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:10.553858 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1dd41-4594-434d-971f-4face67f0ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:10.555078 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1dd41-4594-434d-971f-4face67f0ddc None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:10.555367 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1dd41-4594-434d-971f-4face67f0ddc None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:10.555644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1dd41-4594-434d-971f-4face67f0ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:10.568531 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1dd41-4594-434d-971f-4face67f0ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:10.570025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1dd41-4594-434d-971f-4face67f0ddc None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-23b1dd41-4594-434d-971f-4face67f0ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:10.592292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:10.593226 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:10.594067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:10.594067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:10.594067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:10.594067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:10.594067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 274/520] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:10.595569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1dd41-4594-434d-971f-4face67f0ddc None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:10.627341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f18aee-a6f4-43dc-a1da-c736f474ac2b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:10.633738 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:10.665922 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be5428-84b2-4313-81cf-57ac45365f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:10.666604 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be5428-84b2-4313-81cf-57ac45365f0e None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:10.668082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be5428-84b2-4313-81cf-57ac45365f0e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:10.668780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be5428-84b2-4313-81cf-57ac45365f0e None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:10.669289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be5428-84b2-4313-81cf-57ac45365f0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:10.669606 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be5428-84b2-4313-81cf-57ac45365f0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:10.671118 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be5428-84b2-4313-81cf-57ac45365f0e None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:10.690105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 247/521] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:10.691091 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be5428-84b2-4313-81cf-57ac45365f0e None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:10.718543 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1dd41-4594-434d-971f-4face67f0ddc None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:10.754318 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e79b98-8535-4511-ba75-dc37575a9c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:10.755394 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e79b98-8535-4511-ba75-dc37575a9c1a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:10.755679 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e79b98-8535-4511-ba75-dc37575a9c1a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:10.755954 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e79b98-8535-4511-ba75-dc37575a9c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:10.766984 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e79b98-8535-4511-ba75-dc37575a9c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:10.768457 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e79b98-8535-4511-ba75-dc37575a9c1a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:10.775517 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-d1e79b98-8535-4511-ba75-dc37575a9c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:10.787745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:10.795857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:10.796739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:10.796739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:10.796739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:10.796739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:10.796739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 275/522] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:10.796739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e79b98-8535-4511-ba75-dc37575a9c1a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:10.806818 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be5428-84b2-4313-81cf-57ac45365f0e None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:10.850176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22613b-c514-4939-8407-19072078d124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:10.856368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22613b-c514-4939-8407-19072078d124 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:10.856368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22613b-c514-4939-8407-19072078d124 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:10.856368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22613b-c514-4939-8407-19072078d124 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:10.856368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22613b-c514-4939-8407-19072078d124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:10.856368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22613b-c514-4939-8407-19072078d124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:10.856368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22613b-c514-4939-8407-19072078d124 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:10.873258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 248/523] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:10.873258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22613b-c514-4939-8407-19072078d124 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:10.897553 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:10.914073 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e79b98-8535-4511-ba75-dc37575a9c1a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:10.950617 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcace0b-21be-4feb-bc77-1a075ad61847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:10.951549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcace0b-21be-4feb-bc77-1a075ad61847 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:10.951837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcace0b-21be-4feb-bc77-1a075ad61847 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:10.952113 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcace0b-21be-4feb-bc77-1a075ad61847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:10.952953 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcace0b-21be-4feb-bc77-1a075ad61847 None admin] RBAC: Adding query filter params (role.id=40519a26349f42bc93dc43425e96d7de, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=45eae0d918d5451dab9283e2826ffdb9) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:10.953268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcace0b-21be-4feb-bc77-1a075ad61847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:10.954787 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcace0b-21be-4feb-bc77-1a075ad61847 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:10.960511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 276/524] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:16:10 2022] GET /identity/v3/role_assignments?user.id=45eae0d918d5451dab9283e2826ffdb9&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=40519a26349f42bc93dc43425e96d7de => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:10.961415 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcace0b-21be-4feb-bc77-1a075ad61847 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:11.001150 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22613b-c514-4939-8407-19072078d124 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:11.046377 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb4ca2-67df-45d8-99ad-67d8f2be1662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:11.047179 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb4ca2-67df-45d8-99ad-67d8f2be1662 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.047464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb4ca2-67df-45d8-99ad-67d8f2be1662 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.047739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb4ca2-67df-45d8-99ad-67d8f2be1662 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.048492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb4ca2-67df-45d8-99ad-67d8f2be1662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:11.049421 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb4ca2-67df-45d8-99ad-67d8f2be1662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:11.050383 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb4ca2-67df-45d8-99ad-67d8f2be1662 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:11.053668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:11.065623 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 249/525] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:11.074321 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb4ca2-67df-45d8-99ad-67d8f2be1662 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:11.091188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcace0b-21be-4feb-bc77-1a075ad61847 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:11.133136 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38f701-9648-4528-afb8-96dacc634097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:11.134222 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38f701-9648-4528-afb8-96dacc634097 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.134686 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38f701-9648-4528-afb8-96dacc634097 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.135210 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38f701-9648-4528-afb8-96dacc634097 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.143659 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38f701-9648-4528-afb8-96dacc634097 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:11.145476 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38f701-9648-4528-afb8-96dacc634097 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-6f38f701-9648-4528-afb8-96dacc634097 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:11.162661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:11.163649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:11.164484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:11.164484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:11.164484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:11.164484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:11.164484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:11.164484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:11.164484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:11.164484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:11.172232 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 277/526] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:11.173606 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38f701-9648-4528-afb8-96dacc634097 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:11.190752 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:11.210296 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb4ca2-67df-45d8-99ad-67d8f2be1662 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:11.257575 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba835b0b-9099-4717-8c13-e3618630dc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:11.259194 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba835b0b-9099-4717-8c13-e3618630dc0d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.259868 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba835b0b-9099-4717-8c13-e3618630dc0d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.260772 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba835b0b-9099-4717-8c13-e3618630dc0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.271375 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba835b0b-9099-4717-8c13-e3618630dc0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:11.274216 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba835b0b-9099-4717-8c13-e3618630dc0d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-ba835b0b-9099-4717-8c13-e3618630dc0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:11.293842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:11.294774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:11.295601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:11.295601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:11.295601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:11.295601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:11.295601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:11.295601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:11.295601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:11.295601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:11.302984 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 250/527] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:11.303872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba835b0b-9099-4717-8c13-e3618630dc0d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:11.317128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38f701-9648-4528-afb8-96dacc634097 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:11.369125 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:11.370210 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99c00f-b349-4d23-894d-2b09fa78fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:11.371978 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99c00f-b349-4d23-894d-2b09fa78fe96 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.372444 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99c00f-b349-4d23-894d-2b09fa78fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.373002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99c00f-b349-4d23-894d-2b09fa78fe96 None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.374315 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99c00f-b349-4d23-894d-2b09fa78fe96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:11.375075 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99c00f-b349-4d23-894d-2b09fa78fe96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:11.377229 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99c00f-b349-4d23-894d-2b09fa78fe96 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:11.393847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 278/528] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:11.400087 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99c00f-b349-4d23-894d-2b09fa78fe96 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:11.419859 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba835b0b-9099-4717-8c13-e3618630dc0d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:11.466557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcb283-cb2c-4708-8ebf-f3ee14e31afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:11.467925 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb283-cb2c-4708-8ebf-f3ee14e31afd None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.468648 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb283-cb2c-4708-8ebf-f3ee14e31afd None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.469105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb283-cb2c-4708-8ebf-f3ee14e31afd None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.470799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcb283-cb2c-4708-8ebf-f3ee14e31afd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:11.471299 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcb283-cb2c-4708-8ebf-f3ee14e31afd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:11.473876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcb283-cb2c-4708-8ebf-f3ee14e31afd None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:11.481568 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:11.498278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 251/529] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:11.499497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcb283-cb2c-4708-8ebf-f3ee14e31afd None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:11.534320 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99c00f-b349-4d23-894d-2b09fa78fe96 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:11.582850 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195914f-0a47-4350-a411-2f45b26ac0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:11.583526 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195914f-0a47-4350-a411-2f45b26ac0bf None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.583816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195914f-0a47-4350-a411-2f45b26ac0bf None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.584096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195914f-0a47-4350-a411-2f45b26ac0bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.584945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195914f-0a47-4350-a411-2f45b26ac0bf None admin] RBAC: Adding query filter params (role.id=40519a26349f42bc93dc43425e96d7de, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=b1518eb388a24af9b85e968802e70237) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:11.585265 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195914f-0a47-4350-a411-2f45b26ac0bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:11.586745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195914f-0a47-4350-a411-2f45b26ac0bf None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:11.599061 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 279/530] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:16:11 2022] GET /identity/v3/role_assignments?user.id=b1518eb388a24af9b85e968802e70237&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=40519a26349f42bc93dc43425e96d7de => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:11.619480 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcb283-cb2c-4708-8ebf-f3ee14e31afd None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:11.641916 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:11.663495 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288936b0-aad2-4b02-b0ee-2908634728b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:11.664574 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288936b0-aad2-4b02-b0ee-2908634728b0 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:11.665022 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288936b0-aad2-4b02-b0ee-2908634728b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:11.667073 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288936b0-aad2-4b02-b0ee-2908634728b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:11.667073 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288936b0-aad2-4b02-b0ee-2908634728b0 None admin] RBAC: Adding query filter params (role.id=40519a26349f42bc93dc43425e96d7de, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=85bda15c821448e8b98ae81efb135f3c) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:11.667073 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288936b0-aad2-4b02-b0ee-2908634728b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:11.669335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288936b0-aad2-4b02-b0ee-2908634728b0 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:11.676582 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 252/531] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:16:11 2022] GET /identity/v3/role_assignments?user.id=85bda15c821448e8b98ae81efb135f3c&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=40519a26349f42bc93dc43425e96d7de => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:12.850569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6938b-3a31-4cf4-a8f3-becb6212034e None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:12.851125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6938b-3a31-4cf4-a8f3-becb6212034e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:12.851227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6938b-3a31-4cf4-a8f3-becb6212034e None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:12.852702 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 280/532] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:12.858854 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0c773-cbcb-41e6-a2d5-5a48e4ed36c9 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:12.859346 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0c773-cbcb-41e6-a2d5-5a48e4ed36c9 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:12.859424 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0c773-cbcb-41e6-a2d5-5a48e4ed36c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:12.877017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-61a0c773-cbcb-41e6-a2d5-5a48e4ed36c9 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:12.878221 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-61a0c773-cbcb-41e6-a2d5-5a48e4ed36c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:12.966654 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 253/533] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:12.995434 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6938b-3a31-4cf4-a8f3-becb6212034e None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:13.109822 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6938b-3a31-4cf4-a8f3-becb6212034e None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:13.148160 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a37bb-a0f8-4aee-8d05-96a596d7e471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:13.148961 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a37bb-a0f8-4aee-8d05-96a596d7e471 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:13.149251 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a37bb-a0f8-4aee-8d05-96a596d7e471 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:13.149532 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a37bb-a0f8-4aee-8d05-96a596d7e471 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:13.151394 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:13.161094 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a37bb-a0f8-4aee-8d05-96a596d7e471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-780a37bb-a0f8-4aee-8d05-96a596d7e471 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:13.169240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:13.170152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:13.171002 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 281/534] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:13.178045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0c773-cbcb-41e6-a2d5-5a48e4ed36c9 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:13.284767 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0c773-cbcb-41e6-a2d5-5a48e4ed36c9 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:13.297419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:13.323187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69cb73-9ac7-45ff-8c99-6dacfc0533f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:13.324241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69cb73-9ac7-45ff-8c99-6dacfc0533f1 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:13.325622 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69cb73-9ac7-45ff-8c99-6dacfc0533f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:13.326117 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69cb73-9ac7-45ff-8c99-6dacfc0533f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:13.327090 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69cb73-9ac7-45ff-8c99-6dacfc0533f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:13.327609 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69cb73-9ac7-45ff-8c99-6dacfc0533f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:13.330271 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69cb73-9ac7-45ff-8c99-6dacfc0533f1 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:13.339457 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 254/535] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:13.345854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a37bb-a0f8-4aee-8d05-96a596d7e471 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:13.445085 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af67b-f46e-41fc-9ee1-a2cba398af06 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:13.445381 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af67b-f46e-41fc-9ee1-a2cba398af06 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:13.445583 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af67b-f46e-41fc-9ee1-a2cba398af06 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:13.447187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 255/536] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:13.452595 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fdc4c-0658-4ca5-9cad-771d768777e6 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:13.453146 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fdc4c-0658-4ca5-9cad-771d768777e6 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:13.453643 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fdc4c-0658-4ca5-9cad-771d768777e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:13.459637 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a37bb-a0f8-4aee-8d05-96a596d7e471 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:13.500973 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4e626-1364-4cdb-9365-f284674a6e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:13.501827 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4e626-1364-4cdb-9365-f284674a6e01 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:13.502182 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4e626-1364-4cdb-9365-f284674a6e01 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:13.502461 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4e626-1364-4cdb-9365-f284674a6e01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:13.516943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4e626-1364-4cdb-9365-f284674a6e01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:13.518541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4e626-1364-4cdb-9365-f284674a6e01 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-bfe4e626-1364-4cdb-9365-f284674a6e01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:13.538500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:13.539425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:13.540245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:13.540245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:13.540245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:13.540245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:13.540245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 282/537] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:13.546388 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4e626-1364-4cdb-9365-f284674a6e01 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:13.603024 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:13.604630 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-ff7fdc4c-0658-4ca5-9cad-771d768777e6 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:13.606672 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-ff7fdc4c-0658-4ca5-9cad-771d768777e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:13.675082 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4e626-1364-4cdb-9365-f284674a6e01 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:13.684251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 256/538] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:16:13.708507 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fdc4c-0658-4ca5-9cad-771d768777e6 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:13.727666 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee677cbb-0da3-4906-9273-0b783d71ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:13.728729 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee677cbb-0da3-4906-9273-0b783d71ddca None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:13.729398 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee677cbb-0da3-4906-9273-0b783d71ddca None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:13.729979 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee677cbb-0da3-4906-9273-0b783d71ddca None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:13.731068 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee677cbb-0da3-4906-9273-0b783d71ddca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:13.731604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee677cbb-0da3-4906-9273-0b783d71ddca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:13.733363 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee677cbb-0da3-4906-9273-0b783d71ddca None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:13.748368 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 283/539] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:13.753891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee677cbb-0da3-4906-9273-0b783d71ddca None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:13.828579 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fdc4c-0658-4ca5-9cad-771d768777e6 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:13.830474 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:13.865822 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85680908-38cf-4575-94fe-44445bc7b6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:13.867465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680908-38cf-4575-94fe-44445bc7b6d6 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:13.868002 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680908-38cf-4575-94fe-44445bc7b6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:13.868485 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85680908-38cf-4575-94fe-44445bc7b6d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:13.883110 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85680908-38cf-4575-94fe-44445bc7b6d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:13.889675 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee677cbb-0da3-4906-9273-0b783d71ddca None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-85680908-38cf-4575-94fe-44445bc7b6d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:13.893051 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:13.893913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:13.894717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:13.901937 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 257/540] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:13.903764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85680908-38cf-4575-94fe-44445bc7b6d6 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:13.904018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:13.938149 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b843-daec-42da-818a-2fc537ad5b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:13.939316 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b843-daec-42da-818a-2fc537ad5b2a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:13.939785 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b843-daec-42da-818a-2fc537ad5b2a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:13.940209 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046b843-daec-42da-818a-2fc537ad5b2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:13.949075 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046b843-daec-42da-818a-2fc537ad5b2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:13.951014 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046b843-daec-42da-818a-2fc537ad5b2a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-2046b843-daec-42da-818a-2fc537ad5b2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:13.971052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:13.971964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:13.972843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:13.972843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:13.972843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:13.972843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:13.972843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:13.972843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:13.972843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:13.972843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:13.972843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:13.972843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:13.974716 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 284/541] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 14:16:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:13.978484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b843-daec-42da-818a-2fc537ad5b2a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.023626 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85680908-38cf-4575-94fe-44445bc7b6d6 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.060872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6a48e-94e0-44a6-ade4-8a51b33513ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.061539 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6a48e-94e0-44a6-ade4-8a51b33513ed None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.061823 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6a48e-94e0-44a6-ade4-8a51b33513ed None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.062101 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6a48e-94e0-44a6-ade4-8a51b33513ed None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.062874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6a48e-94e0-44a6-ade4-8a51b33513ed None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:14.063184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6a48e-94e0-44a6-ade4-8a51b33513ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:14.064574 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6a48e-94e0-44a6-ade4-8a51b33513ed None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:14.072986 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 258/542] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:14.074258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9b963-f99d-4133-93f1-ad495f09fa5f None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.074573 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9b963-f99d-4133-93f1-ad495f09fa5f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.074882 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9b963-f99d-4133-93f1-ad495f09fa5f None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.077298 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 259/543] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:14.077468 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0a9ed-19aa-4294-a2b2-aee5e3b476c4 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.077753 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0a9ed-19aa-4294-a2b2-aee5e3b476c4 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.078034 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0a9ed-19aa-4294-a2b2-aee5e3b476c4 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.079260 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 260/544] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:14.079954 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0a9ed-19aa-4294-a2b2-aee5e3b476c4 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.101878 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046b843-daec-42da-818a-2fc537ad5b2a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.106749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:14.136475 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d580895-26f6-4bca-810e-8bf06c4d3b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.137148 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580895-26f6-4bca-810e-8bf06c4d3b94 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.137427 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580895-26f6-4bca-810e-8bf06c4d3b94 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.137702 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580895-26f6-4bca-810e-8bf06c4d3b94 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.138541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d580895-26f6-4bca-810e-8bf06c4d3b94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:14.138881 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d580895-26f6-4bca-810e-8bf06c4d3b94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:14.140309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d580895-26f6-4bca-810e-8bf06c4d3b94 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:14.157596 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 285/545] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 14:16:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:14.158981 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a1d8-09ec-44a5-96d1-12eb9793e9b8 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.159267 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a1d8-09ec-44a5-96d1-12eb9793e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.159540 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a1d8-09ec-44a5-96d1-12eb9793e9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.177144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-4315a1d8-09ec-44a5-96d1-12eb9793e9b8 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:14.178764 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-4315a1d8-09ec-44a5-96d1-12eb9793e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:14.184928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0a9ed-19aa-4294-a2b2-aee5e3b476c4 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.195576 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:14.219850 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f71fc-8da8-4049-9f00-8a1df0fe8e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.220640 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f71fc-8da8-4049-9f00-8a1df0fe8e1d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.220927 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f71fc-8da8-4049-9f00-8a1df0fe8e1d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.221252 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f71fc-8da8-4049-9f00-8a1df0fe8e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.231891 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f71fc-8da8-4049-9f00-8a1df0fe8e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:14.233250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f71fc-8da8-4049-9f00-8a1df0fe8e1d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:14.245976 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 286/546] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:14.247536 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ceed06-9e18-4add-9f90-7899ffb37dfb None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.247826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ceed06-9e18-4add-9f90-7899ffb37dfb None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.248102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ceed06-9e18-4add-9f90-7899ffb37dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-8c6f71fc-8da8-4049-9f00-8a1df0fe8e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:14.250763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:14.251590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:14.252425 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:14.252425 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:14.252425 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:14.252425 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:14.252425 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 261/547] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:14.253242 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f71fc-8da8-4049-9f00-8a1df0fe8e1d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.282356 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-48ceed06-9e18-4add-9f90-7899ffb37dfb None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:14.283729 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-48ceed06-9e18-4add-9f90-7899ffb37dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:14.332528 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:14.349961 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 287/548] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:14.351108 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ceed06-9e18-4add-9f90-7899ffb37dfb None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.356412 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f71fc-8da8-4049-9f00-8a1df0fe8e1d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.394223 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44b164-6dc4-4956-8480-f383b0eea1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.395054 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b164-6dc4-4956-8480-f383b0eea1bc None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.395335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b164-6dc4-4956-8480-f383b0eea1bc None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.395610 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b164-6dc4-4956-8480-f383b0eea1bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.407482 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44b164-6dc4-4956-8480-f383b0eea1bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:14.408937 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44b164-6dc4-4956-8480-f383b0eea1bc None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-fd44b164-6dc4-4956-8480-f383b0eea1bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:14.425902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:14.426949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:14.428068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:14.428068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:14.428068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:14.428068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:14.428068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 262/549] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:14.428068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44b164-6dc4-4956-8480-f383b0eea1bc None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.437769 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:14.454043 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ceed06-9e18-4add-9f90-7899ffb37dfb None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.488505 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442ba9a-2dbe-46b9-bc92-892ea83e9bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.489104 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442ba9a-2dbe-46b9-bc92-892ea83e9bf9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.489391 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442ba9a-2dbe-46b9-bc92-892ea83e9bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.489675 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442ba9a-2dbe-46b9-bc92-892ea83e9bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.490402 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442ba9a-2dbe-46b9-bc92-892ea83e9bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:14.490748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442ba9a-2dbe-46b9-bc92-892ea83e9bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:14.492122 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442ba9a-2dbe-46b9-bc92-892ea83e9bf9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:14.503355 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 288/550] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:14.504267 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442ba9a-2dbe-46b9-bc92-892ea83e9bf9 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.529128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44b164-6dc4-4956-8480-f383b0eea1bc None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.555519 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:14.564966 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fee19-00fe-40e1-9601-ff5172facb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.565827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fee19-00fe-40e1-9601-ff5172facb5f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.566049 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fee19-00fe-40e1-9601-ff5172facb5f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.566326 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fee19-00fe-40e1-9601-ff5172facb5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.577481 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fee19-00fe-40e1-9601-ff5172facb5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-841fee19-00fe-40e1-9601-ff5172facb5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:14.585094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:14.586752 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 263/551] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:14.588339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fee19-00fe-40e1-9601-ff5172facb5f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.610998 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442ba9a-2dbe-46b9-bc92-892ea83e9bf9 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.645480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8ffe0-fa9c-4055-8d3e-04cec742b371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.646272 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8ffe0-fa9c-4055-8d3e-04cec742b371 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.646556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8ffe0-fa9c-4055-8d3e-04cec742b371 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.646862 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8ffe0-fa9c-4055-8d3e-04cec742b371 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.657040 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8ffe0-fa9c-4055-8d3e-04cec742b371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-d9e8ffe0-fa9c-4055-8d3e-04cec742b371 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:14.664742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:14.665762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:14.666600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 289/552] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:14.667723 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8ffe0-fa9c-4055-8d3e-04cec742b371 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.671900 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:14.693985 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fee19-00fe-40e1-9601-ff5172facb5f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.729438 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b75d0e-a0a9-4180-9c39-da3cf6852b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.730183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b75d0e-a0a9-4180-9c39-da3cf6852b30 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.730548 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b75d0e-a0a9-4180-9c39-da3cf6852b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.731050 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b75d0e-a0a9-4180-9c39-da3cf6852b30 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.731849 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b75d0e-a0a9-4180-9c39-da3cf6852b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:14.732228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b75d0e-a0a9-4180-9c39-da3cf6852b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:14.733671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b75d0e-a0a9-4180-9c39-da3cf6852b30 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:14.745109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 264/553] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:14.745884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b75d0e-a0a9-4180-9c39-da3cf6852b30 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.773239 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8ffe0-fa9c-4055-8d3e-04cec742b371 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.795867 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:14.806843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea087c5-7219-42e6-8877-c7e0d1a8109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.807641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea087c5-7219-42e6-8877-c7e0d1a8109c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.807966 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea087c5-7219-42e6-8877-c7e0d1a8109c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.808225 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea087c5-7219-42e6-8877-c7e0d1a8109c None admin] PATH_INFO: `/v3/users/glance` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.816494 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea087c5-7219-42e6-8877-c7e0d1a8109c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:14.817953 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea087c5-7219-42e6-8877-c7e0d1a8109c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-aea087c5-7219-42e6-8877-c7e0d1a8109c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:14.833170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:14.834262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 290/554] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:16:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:14.835413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea087c5-7219-42e6-8877-c7e0d1a8109c None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.850958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b75d0e-a0a9-4180-9c39-da3cf6852b30 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.885182 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7eea24-c63e-4ecd-8d3e-f74f00928201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.885851 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eea24-c63e-4ecd-8d3e-f74f00928201 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.886158 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eea24-c63e-4ecd-8d3e-f74f00928201 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.886439 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eea24-c63e-4ecd-8d3e-f74f00928201 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.887935 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7eea24-c63e-4ecd-8d3e-f74f00928201 None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:14.888239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7eea24-c63e-4ecd-8d3e-f74f00928201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:14.889613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7eea24-c63e-4ecd-8d3e-f74f00928201 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:14.900973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 265/555] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:14.901793 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7eea24-c63e-4ecd-8d3e-f74f00928201 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:14.916459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:14.955067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea087c5-7219-42e6-8877-c7e0d1a8109c None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:14.988629 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bd155-bd45-4fa1-802d-eea39bf86cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:14.989286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bd155-bd45-4fa1-802d-eea39bf86cf7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:14.989569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bd155-bd45-4fa1-802d-eea39bf86cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:14.989850 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bd155-bd45-4fa1-802d-eea39bf86cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:14.990591 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bd155-bd45-4fa1-802d-eea39bf86cf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:14.990930 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bd155-bd45-4fa1-802d-eea39bf86cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:14.992296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bd155-bd45-4fa1-802d-eea39bf86cf7 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.000288 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 291/556] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:15.001012 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bd155-bd45-4fa1-802d-eea39bf86cf7 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.001542 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7eea24-c63e-4ecd-8d3e-f74f00928201 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.013153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:15.036810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e178515-5481-47dc-b850-448c8b472dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.037631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e178515-5481-47dc-b850-448c8b472dd5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.037928 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e178515-5481-47dc-b850-448c8b472dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.038470 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e178515-5481-47dc-b850-448c8b472dd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.045883 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e178515-5481-47dc-b850-448c8b472dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.047377 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e178515-5481-47dc-b850-448c8b472dd5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-0e178515-5481-47dc-b850-448c8b472dd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:15.061959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:15.064003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:15.065092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:15.065092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:15.065092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:15.065092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:15.065092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:15.065092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:15.065092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:15.065092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:15.065092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 266/557] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:15.065092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e178515-5481-47dc-b850-448c8b472dd5 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.107638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bd155-bd45-4fa1-802d-eea39bf86cf7 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.132482 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:15.141505 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432320-b9b1-47b7-b3b0-a903c0dee420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.142179 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432320-b9b1-47b7-b3b0-a903c0dee420 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.142457 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432320-b9b1-47b7-b3b0-a903c0dee420 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.142773 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432320-b9b1-47b7-b3b0-a903c0dee420 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.143614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432320-b9b1-47b7-b3b0-a903c0dee420 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:15.143932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432320-b9b1-47b7-b3b0-a903c0dee420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.145377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432320-b9b1-47b7-b3b0-a903c0dee420 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.162993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 292/558] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 14:16:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:15.163805 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432320-b9b1-47b7-b3b0-a903c0dee420 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.173346 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e178515-5481-47dc-b850-448c8b472dd5 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.206154 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b6837-6318-4aa3-9c6c-c7c7aa348d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.206961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6837-6318-4aa3-9c6c-c7c7aa348d0b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.207249 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6837-6318-4aa3-9c6c-c7c7aa348d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.207517 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b6837-6318-4aa3-9c6c-c7c7aa348d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.218852 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b6837-6318-4aa3-9c6c-c7c7aa348d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.220316 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b6837-6318-4aa3-9c6c-c7c7aa348d0b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-691b6837-6318-4aa3-9c6c-c7c7aa348d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:15.237300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:15.238317 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:15.239242 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:15.239242 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:15.239242 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:15.239242 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:15.239242 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 267/559] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:15.239509 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b6837-6318-4aa3-9c6c-c7c7aa348d0b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.264623 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:15.268700 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432320-b9b1-47b7-b3b0-a903c0dee420 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.304555 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50220dec-3208-4bf2-b3cc-2390ec0758b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.305342 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50220dec-3208-4bf2-b3cc-2390ec0758b5 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.305621 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50220dec-3208-4bf2-b3cc-2390ec0758b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.305900 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50220dec-3208-4bf2-b3cc-2390ec0758b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.315986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50220dec-3208-4bf2-b3cc-2390ec0758b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.317431 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50220dec-3208-4bf2-b3cc-2390ec0758b5 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-50220dec-3208-4bf2-b3cc-2390ec0758b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:15.335168 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:15.336125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:15.337000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:15.337000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:15.337000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:15.337000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:15.337000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 293/560] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:15.337287 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50220dec-3208-4bf2-b3cc-2390ec0758b5 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.348188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b6837-6318-4aa3-9c6c-c7c7aa348d0b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.375510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:15.381605 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0cb00-daa6-4b96-ae79-ecd7269066a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.387588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0cb00-daa6-4b96-ae79-ecd7269066a1 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.387588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0cb00-daa6-4b96-ae79-ecd7269066a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.387588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0cb00-daa6-4b96-ae79-ecd7269066a1 None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.387588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0cb00-daa6-4b96-ae79-ecd7269066a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:15.387588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0cb00-daa6-4b96-ae79-ecd7269066a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.387588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0cb00-daa6-4b96-ae79-ecd7269066a1 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.398985 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 268/561] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:15.399986 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0cb00-daa6-4b96-ae79-ecd7269066a1 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.446902 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50220dec-3208-4bf2-b3cc-2390ec0758b5 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.480789 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea33be-d91b-4805-9045-8a1713fa4218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.481137 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:15.481823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea33be-d91b-4805-9045-8a1713fa4218 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.482186 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea33be-d91b-4805-9045-8a1713fa4218 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.482389 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea33be-d91b-4805-9045-8a1713fa4218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.492266 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea33be-d91b-4805-9045-8a1713fa4218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.495466 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea33be-d91b-4805-9045-8a1713fa4218 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.499132 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0cb00-daa6-4b96-ae79-ecd7269066a1 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-cfea33be-d91b-4805-9045-8a1713fa4218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:15.512846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:15.514821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:15.516032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:15.516032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:15.516032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:15.516032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:15.516032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 294/562] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:15.516032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea33be-d91b-4805-9045-8a1713fa4218 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.537328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1eb64-14f7-4e64-b3f5-a6f3b16cc39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.537985 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1eb64-14f7-4e64-b3f5-a6f3b16cc39b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.538265 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1eb64-14f7-4e64-b3f5-a6f3b16cc39b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.538537 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1eb64-14f7-4e64-b3f5-a6f3b16cc39b None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.539300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1eb64-14f7-4e64-b3f5-a6f3b16cc39b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:15.539607 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1eb64-14f7-4e64-b3f5-a6f3b16cc39b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.540969 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1eb64-14f7-4e64-b3f5-a6f3b16cc39b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.552406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 269/563] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:15.553202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1eb64-14f7-4e64-b3f5-a6f3b16cc39b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.616747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:15.629285 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea33be-d91b-4805-9045-8a1713fa4218 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.654527 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1eb64-14f7-4e64-b3f5-a6f3b16cc39b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.663922 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2d691-bd32-4de4-9fec-68e473b3faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.664579 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2d691-bd32-4de4-9fec-68e473b3faaf None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.664882 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2d691-bd32-4de4-9fec-68e473b3faaf None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.665136 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2d691-bd32-4de4-9fec-68e473b3faaf None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.665907 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2d691-bd32-4de4-9fec-68e473b3faaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:15.666219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2d691-bd32-4de4-9fec-68e473b3faaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.667619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2d691-bd32-4de4-9fec-68e473b3faaf None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.678554 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 295/564] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:15.679365 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2d691-bd32-4de4-9fec-68e473b3faaf None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.688864 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701edf3a-370d-46f2-8ca9-5e15b9678b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.689763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701edf3a-370d-46f2-8ca9-5e15b9678b6b None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.690045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701edf3a-370d-46f2-8ca9-5e15b9678b6b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.690323 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701edf3a-370d-46f2-8ca9-5e15b9678b6b None admin] PATH_INFO: `/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/d9fa78e7e5be4bdcbd5c79a24895299d/roles/40519a26349f42bc93dc43425e96d7de` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.703069 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:15.706092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701edf3a-370d-46f2-8ca9-5e15b9678b6b None admin] RBAC: Authorizing `identity:create_grant(project_id=e5992534cc13499cb1ae95958d96ca9c, user_id=d9fa78e7e5be4bdcbd5c79a24895299d, role_id=40519a26349f42bc93dc43425e96d7de)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.707613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701edf3a-370d-46f2-8ca9-5e15b9678b6b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.779519 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2d691-bd32-4de4-9fec-68e473b3faaf None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.799078 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 270/565] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:16:15 2022] PUT /identity/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/d9fa78e7e5be4bdcbd5c79a24895299d/roles/40519a26349f42bc93dc43425e96d7de => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:16:15.799931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701edf3a-370d-46f2-8ca9-5e15b9678b6b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.817313 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086250-579c-467f-88bb-fd26b56b8079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.818276 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086250-579c-467f-88bb-fd26b56b8079 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.818566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086250-579c-467f-88bb-fd26b56b8079 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.818890 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086250-579c-467f-88bb-fd26b56b8079 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.819846 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e086250-579c-467f-88bb-fd26b56b8079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:15.820495 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e086250-579c-467f-88bb-fd26b56b8079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.821933 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e086250-579c-467f-88bb-fd26b56b8079 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:15.836581 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 296/566] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:15.837515 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086250-579c-467f-88bb-fd26b56b8079 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:15.851261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:15.929974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701edf3a-370d-46f2-8ca9-5e15b9678b6b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.965800 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086250-579c-467f-88bb-fd26b56b8079 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:15.970780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed441443-6a76-4843-ac0a-ab07875cca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:15.971595 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed441443-6a76-4843-ac0a-ab07875cca51 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:15.971883 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed441443-6a76-4843-ac0a-ab07875cca51 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:15.972164 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed441443-6a76-4843-ac0a-ab07875cca51 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:15.980342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed441443-6a76-4843-ac0a-ab07875cca51 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:15.982022 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed441443-6a76-4843-ac0a-ab07875cca51 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-ed441443-6a76-4843-ac0a-ab07875cca51 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:16.000077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:16.001288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 271/567] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:16:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:16.002406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed441443-6a76-4843-ac0a-ab07875cca51 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.015377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44930be-9c31-437c-a253-4e4e4617621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:16.016188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44930be-9c31-437c-a253-4e4e4617621b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:16.016478 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44930be-9c31-437c-a253-4e4e4617621b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:16.016763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44930be-9c31-437c-a253-4e4e4617621b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:16.024896 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44930be-9c31-437c-a253-4e4e4617621b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:16.026337 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44930be-9c31-437c-a253-4e4e4617621b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-a44930be-9c31-437c-a253-4e4e4617621b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:16.041848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:16.042830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 297/568] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:16.044228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44930be-9c31-437c-a253-4e4e4617621b None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.070160 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:16.119074 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:16.123064 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed441443-6a76-4843-ac0a-ab07875cca51 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:16.154343 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44930be-9c31-437c-a253-4e4e4617621b None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:16.159776 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93543fb6-b8ff-4c85-95f6-365618920279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:16.160583 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93543fb6-b8ff-4c85-95f6-365618920279 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:16.160869 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93543fb6-b8ff-4c85-95f6-365618920279 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:16.161154 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93543fb6-b8ff-4c85-95f6-365618920279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:16.172354 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93543fb6-b8ff-4c85-95f6-365618920279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:16.175959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93543fb6-b8ff-4c85-95f6-365618920279 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.188428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ab973-046a-4a36-9378-ce6bda09f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:16.189094 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ab973-046a-4a36-9378-ce6bda09f119 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-93543fb6-b8ff-4c85-95f6-365618920279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:16.189196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:16.190014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:16.191258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:16.191258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:16.191258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:16.191258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:16.191258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:16.191258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:16.191258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:16.191258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:16.191703 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ab973-046a-4a36-9378-ce6bda09f119 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:16.191703 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ab973-046a-4a36-9378-ce6bda09f119 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:16.191837 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 272/569] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:16.191837 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93543fb6-b8ff-4c85-95f6-365618920279 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.194328 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ab973-046a-4a36-9378-ce6bda09f119 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:16.194726 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ab973-046a-4a36-9378-ce6bda09f119 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:16.196215 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ab973-046a-4a36-9378-ce6bda09f119 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.220828 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 298/570] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 14:16:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:16.220828 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ab973-046a-4a36-9378-ce6bda09f119 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.304733 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93543fb6-b8ff-4c85-95f6-365618920279 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:16.319288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:16.320988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ab973-046a-4a36-9378-ce6bda09f119 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:16.345235 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141c1f-49c2-498c-b219-c87c077f635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:16.346313 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141c1f-49c2-498c-b219-c87c077f635b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:16.346777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141c1f-49c2-498c-b219-c87c077f635b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:16.347205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141c1f-49c2-498c-b219-c87c077f635b None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:16.347963 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:16.349067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98141c1f-49c2-498c-b219-c87c077f635b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:16.349380 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98141c1f-49c2-498c-b219-c87c077f635b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:16.350840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98141c1f-49c2-498c-b219-c87c077f635b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.357616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085e21a-7ba4-457c-a877-82f7ea5d4ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:16.358280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085e21a-7ba4-457c-a877-82f7ea5d4ad0 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:16.358568 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085e21a-7ba4-457c-a877-82f7ea5d4ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:16.364750 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085e21a-7ba4-457c-a877-82f7ea5d4ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:16.364750 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085e21a-7ba4-457c-a877-82f7ea5d4ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:16.364750 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085e21a-7ba4-457c-a877-82f7ea5d4ad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:16.364750 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085e21a-7ba4-457c-a877-82f7ea5d4ad0 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.377956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 299/571] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:16.377956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085e21a-7ba4-457c-a877-82f7ea5d4ad0 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.378217 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 273/572] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Jun 2 14:16:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:16.378217 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141c1f-49c2-498c-b219-c87c077f635b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.483048 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085e21a-7ba4-457c-a877-82f7ea5d4ad0 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:16.497171 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141c1f-49c2-498c-b219-c87c077f635b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:16.521625 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a508840-8c59-44bd-8023-2893635e3925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:16.522431 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a508840-8c59-44bd-8023-2893635e3925 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:16.522734 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a508840-8c59-44bd-8023-2893635e3925 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:16.523011 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a508840-8c59-44bd-8023-2893635e3925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:16.533226 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212245c-fa05-4bfd-9f20-bb80db80df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:16.534020 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212245c-fa05-4bfd-9f20-bb80db80df80 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:16.534243 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a508840-8c59-44bd-8023-2893635e3925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:16.534345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212245c-fa05-4bfd-9f20-bb80db80df80 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:16.534557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212245c-fa05-4bfd-9f20-bb80db80df80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:16.535746 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a508840-8c59-44bd-8023-2893635e3925 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.545849 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212245c-fa05-4bfd-9f20-bb80db80df80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:16.547341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212245c-fa05-4bfd-9f20-bb80db80df80 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-9a508840-8c59-44bd-8023-2893635e3925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:16.554437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:16.555400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:16.556290 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:16.556290 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:16.556290 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:16.556290 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:16.560688 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 300/573] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:16.561339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a508840-8c59-44bd-8023-2893635e3925 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-6212245c-fa05-4bfd-9f20-bb80db80df80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:16.567121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:16.567960 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:16.569241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:16.569241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:16.569241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:16.569241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:16.569944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 274/574] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:16.570998 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212245c-fa05-4bfd-9f20-bb80db80df80 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.602780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:16.607307 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:16.673642 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a508840-8c59-44bd-8023-2893635e3925 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:16.684619 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212245c-fa05-4bfd-9f20-bb80db80df80 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:16.710797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5bcd6-d9c6-4fb3-87f6-07b3673fe866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:16.711766 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5bcd6-d9c6-4fb3-87f6-07b3673fe866 None admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:16.712164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5bcd6-d9c6-4fb3-87f6-07b3673fe866 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:16.712452 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5bcd6-d9c6-4fb3-87f6-07b3673fe866 None admin] PATH_INFO: `/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/45eae0d918d5451dab9283e2826ffdb9/roles/40519a26349f42bc93dc43425e96d7de` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:16.722019 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecdc55-e016-4194-8e9c-1d2f6ba81fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:16.722790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecdc55-e016-4194-8e9c-1d2f6ba81fd1 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:16.723156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecdc55-e016-4194-8e9c-1d2f6ba81fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:16.723540 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecdc55-e016-4194-8e9c-1d2f6ba81fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:16.724361 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecdc55-e016-4194-8e9c-1d2f6ba81fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:16.724843 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecdc55-e016-4194-8e9c-1d2f6ba81fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:16.726265 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecdc55-e016-4194-8e9c-1d2f6ba81fd1 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.730028 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5bcd6-d9c6-4fb3-87f6-07b3673fe866 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5992534cc13499cb1ae95958d96ca9c, user_id=45eae0d918d5451dab9283e2826ffdb9, role_id=40519a26349f42bc93dc43425e96d7de)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:16.732132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5bcd6-d9c6-4fb3-87f6-07b3673fe866 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.738650 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 275/575] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:16.739558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecdc55-e016-4194-8e9c-1d2f6ba81fd1 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.796324 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 301/576] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:16:16 2022] PUT /identity/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/45eae0d918d5451dab9283e2826ffdb9/roles/40519a26349f42bc93dc43425e96d7de => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:16:16.803710 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5bcd6-d9c6-4fb3-87f6-07b3673fe866 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.829211 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:16.851725 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecdc55-e016-4194-8e9c-1d2f6ba81fd1 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:16.900068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823fd62-32ec-45ee-98b6-683a5fbfda0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:16.900798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823fd62-32ec-45ee-98b6-683a5fbfda0c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:16.901138 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823fd62-32ec-45ee-98b6-683a5fbfda0c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:16.901462 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823fd62-32ec-45ee-98b6-683a5fbfda0c None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:16.902298 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823fd62-32ec-45ee-98b6-683a5fbfda0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:16.903228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823fd62-32ec-45ee-98b6-683a5fbfda0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:16.904742 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823fd62-32ec-45ee-98b6-683a5fbfda0c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:16.925772 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 276/577] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:16.927224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823fd62-32ec-45ee-98b6-683a5fbfda0c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:16.946742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:16.968577 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5bcd6-d9c6-4fb3-87f6-07b3673fe866 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:17.018219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e047-f2fd-49b6-adbc-9d03f013f6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:17.019490 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e047-f2fd-49b6-adbc-9d03f013f6a2 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:17.019696 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e047-f2fd-49b6-adbc-9d03f013f6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:17.020118 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e047-f2fd-49b6-adbc-9d03f013f6a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:17.029850 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946e047-f2fd-49b6-adbc-9d03f013f6a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:17.032744 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946e047-f2fd-49b6-adbc-9d03f013f6a2 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-4946e047-f2fd-49b6-adbc-9d03f013f6a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:17.049231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:17.050271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:17.051567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:17.051567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:17.051567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:17.051567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:17.051567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:17.051567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:17.051567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:17.051567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:17.051567 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 302/578] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:17.056959 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e047-f2fd-49b6-adbc-9d03f013f6a2 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:17.068343 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823fd62-32ec-45ee-98b6-683a5fbfda0c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:17.107331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806aca9-9c1b-4afd-bc02-8f6f1092878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:17.108286 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806aca9-9c1b-4afd-bc02-8f6f1092878a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:17.108616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806aca9-9c1b-4afd-bc02-8f6f1092878a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:17.108897 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806aca9-9c1b-4afd-bc02-8f6f1092878a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:17.116260 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806aca9-9c1b-4afd-bc02-8f6f1092878a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:17.117950 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806aca9-9c1b-4afd-bc02-8f6f1092878a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-1806aca9-9c1b-4afd-bc02-8f6f1092878a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:17.132419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:17.133332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:17.134228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:17.134228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:17.134228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:17.134228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:17.134228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:17.134228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:17.134228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:17.134228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:17.134228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 277/579] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:17.140052 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806aca9-9c1b-4afd-bc02-8f6f1092878a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:17.150975 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:17.191659 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e047-f2fd-49b6-adbc-9d03f013f6a2 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:17.236433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1731381-1fde-4857-a430-5e83457a5fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:17.237259 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1731381-1fde-4857-a430-5e83457a5fd1 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:17.237644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1731381-1fde-4857-a430-5e83457a5fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:17.238019 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1731381-1fde-4857-a430-5e83457a5fd1 None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:17.239003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1731381-1fde-4857-a430-5e83457a5fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:17.239461 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1731381-1fde-4857-a430-5e83457a5fd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:17.241088 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1731381-1fde-4857-a430-5e83457a5fd1 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:17.251984 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806aca9-9c1b-4afd-bc02-8f6f1092878a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:17.260070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 303/580] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:17.261196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1731381-1fde-4857-a430-5e83457a5fd1 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:17.273459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:17.298028 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b128d-b083-4e1a-8dd5-33997317f7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:17.299033 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b128d-b083-4e1a-8dd5-33997317f7ea None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:17.299624 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b128d-b083-4e1a-8dd5-33997317f7ea None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:17.300073 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b128d-b083-4e1a-8dd5-33997317f7ea None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:17.301813 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b128d-b083-4e1a-8dd5-33997317f7ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:17.302292 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b128d-b083-4e1a-8dd5-33997317f7ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:17.304017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b128d-b083-4e1a-8dd5-33997317f7ea None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:17.321865 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 278/581] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:17.328176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b128d-b083-4e1a-8dd5-33997317f7ea None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:17.384409 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1731381-1fde-4857-a430-5e83457a5fd1 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:17.421633 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:17.421967 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4f210-a065-4c11-98ad-ea93ca0458d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:17.422874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4f210-a065-4c11-98ad-ea93ca0458d3 None admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:17.423162 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4f210-a065-4c11-98ad-ea93ca0458d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:17.423442 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4f210-a065-4c11-98ad-ea93ca0458d3 None admin] PATH_INFO: `/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/b1518eb388a24af9b85e968802e70237/roles/40519a26349f42bc93dc43425e96d7de` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:17.440155 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4f210-a065-4c11-98ad-ea93ca0458d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5992534cc13499cb1ae95958d96ca9c, user_id=b1518eb388a24af9b85e968802e70237, role_id=40519a26349f42bc93dc43425e96d7de)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:17.441675 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4f210-a065-4c11-98ad-ea93ca0458d3 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:17.466309 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b128d-b083-4e1a-8dd5-33997317f7ea None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:17.502334 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c7d57-906a-46cc-9681-af4d1910f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:17.503617 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c7d57-906a-46cc-9681-af4d1910f74f None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:17.504127 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c7d57-906a-46cc-9681-af4d1910f74f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:17.504634 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c7d57-906a-46cc-9681-af4d1910f74f None admin] PATH_INFO: `/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/85bda15c821448e8b98ae81efb135f3c/roles/40519a26349f42bc93dc43425e96d7de` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:17.521386 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c7d57-906a-46cc-9681-af4d1910f74f None admin] RBAC: Authorizing `identity:create_grant(project_id=e5992534cc13499cb1ae95958d96ca9c, user_id=85bda15c821448e8b98ae81efb135f3c, role_id=40519a26349f42bc93dc43425e96d7de)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:17.523112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c7d57-906a-46cc-9681-af4d1910f74f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:17.548233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 304/582] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:16:17 2022] PUT /identity/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/b1518eb388a24af9b85e968802e70237/roles/40519a26349f42bc93dc43425e96d7de => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:16:17.612342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 279/583] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:16:17 2022] PUT /identity/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/85bda15c821448e8b98ae81efb135f3c/roles/40519a26349f42bc93dc43425e96d7de => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:16:18.218816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902b0b6-7a8c-47ce-a5f3-4b9e3fcbd73b None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:18.219321 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902b0b6-7a8c-47ce-a5f3-4b9e3fcbd73b None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:18.219321 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902b0b6-7a8c-47ce-a5f3-4b9e3fcbd73b None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:18.221175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 305/584] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:18.226912 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf032d1-7de2-4017-acba-3574cf5ddfcb None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:18.227313 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf032d1-7de2-4017-acba-3574cf5ddfcb None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:18.227536 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf032d1-7de2-4017-acba-3574cf5ddfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:18.245416 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-daf032d1-7de2-4017-acba-3574cf5ddfcb None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:18.247210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-daf032d1-7de2-4017-acba-3574cf5ddfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:18.322805 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 280/585] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:18.343330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902b0b6-7a8c-47ce-a5f3-4b9e3fcbd73b None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:18.408871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:18.453496 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902b0b6-7a8c-47ce-a5f3-4b9e3fcbd73b None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:18.489940 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c228a81-ff00-4f28-a8f0-3ef0804bcdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:18.490856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c228a81-ff00-4f28-a8f0-3ef0804bcdd8 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:18.491146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c228a81-ff00-4f28-a8f0-3ef0804bcdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:18.491426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c228a81-ff00-4f28-a8f0-3ef0804bcdd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:18.502213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c228a81-ff00-4f28-a8f0-3ef0804bcdd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-4c228a81-ff00-4f28-a8f0-3ef0804bcdd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:18.510616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:18.511549 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:18.512910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:18.516350 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 306/586] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:18.518182 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf032d1-7de2-4017-acba-3574cf5ddfcb None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:18.563667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:18.624564 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf032d1-7de2-4017-acba-3574cf5ddfcb None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:18.661108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02593d3-4f1c-4128-ba75-2f99ee474717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:18.661781 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02593d3-4f1c-4128-ba75-2f99ee474717 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:18.662071 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02593d3-4f1c-4128-ba75-2f99ee474717 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:18.662346 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02593d3-4f1c-4128-ba75-2f99ee474717 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:18.663137 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02593d3-4f1c-4128-ba75-2f99ee474717 None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:18.663445 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02593d3-4f1c-4128-ba75-2f99ee474717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:18.664829 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02593d3-4f1c-4128-ba75-2f99ee474717 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:18.678308 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 281/587] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:18.679701 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c228a81-ff00-4f28-a8f0-3ef0804bcdd8 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:18.787859 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c228a81-ff00-4f28-a8f0-3ef0804bcdd8 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:18.808560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:18.826409 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bd2e0-955f-49a2-8e4e-85fa2a0ab43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:18.827245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd2e0-955f-49a2-8e4e-85fa2a0ab43e None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:18.827533 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd2e0-955f-49a2-8e4e-85fa2a0ab43e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:18.827812 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd2e0-955f-49a2-8e4e-85fa2a0ab43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:18.839071 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bd2e0-955f-49a2-8e4e-85fa2a0ab43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:18.840663 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bd2e0-955f-49a2-8e4e-85fa2a0ab43e None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-084bd2e0-955f-49a2-8e4e-85fa2a0ab43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:18.859141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:18.860095 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:18.860972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:18.860972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:18.860972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:18.860972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:18.865427 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 307/588] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:18.866964 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02593d3-4f1c-4128-ba75-2f99ee474717 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:18.978558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02593d3-4f1c-4128-ba75-2f99ee474717 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:18.981360 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:19.014295 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df16df9-d10b-4245-89e2-e9a7b6b8073d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:19.014991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df16df9-d10b-4245-89e2-e9a7b6b8073d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:19.015286 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df16df9-d10b-4245-89e2-e9a7b6b8073d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:19.015563 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df16df9-d10b-4245-89e2-e9a7b6b8073d None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:19.016361 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df16df9-d10b-4245-89e2-e9a7b6b8073d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:19.016674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df16df9-d10b-4245-89e2-e9a7b6b8073d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:19.018065 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df16df9-d10b-4245-89e2-e9a7b6b8073d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:19.034766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 282/589] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:19.036887 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bd2e0-955f-49a2-8e4e-85fa2a0ab43e None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:19.145233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bd2e0-955f-49a2-8e4e-85fa2a0ab43e None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:19.181854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1cbdb-5a30-4454-9935-fd2bd14fe6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:19.182670 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1cbdb-5a30-4454-9935-fd2bd14fe6f3 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:19.182967 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1cbdb-5a30-4454-9935-fd2bd14fe6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:19.183250 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1cbdb-5a30-4454-9935-fd2bd14fe6f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:19.191742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1cbdb-5a30-4454-9935-fd2bd14fe6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:19.193213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1cbdb-5a30-4454-9935-fd2bd14fe6f3 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-4ef1cbdb-5a30-4454-9935-fd2bd14fe6f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:19.208196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:19.209132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:19.210077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:19.210077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:19.210077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:19.210077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:19.210077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:19.210077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:19.210077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:19.210077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:19.210077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:19.210077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:19.214041 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 308/590] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 14:16:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:19.215638 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df16df9-d10b-4245-89e2-e9a7b6b8073d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:19.233011 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b141b6-7d8a-4d8b-9ef9-339d1e4d4c84 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:19.233499 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b141b6-7d8a-4d8b-9ef9-339d1e4d4c84 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:19.233608 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b141b6-7d8a-4d8b-9ef9-339d1e4d4c84 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:19.235691 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 309/591] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:19.241192 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1b4ae-9cef-4f48-8515-19d1497af529 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:19.241487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1b4ae-9cef-4f48-8515-19d1497af529 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:19.241768 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1b4ae-9cef-4f48-8515-19d1497af529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:19.264581 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-0da1b4ae-9cef-4f48-8515-19d1497af529 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:19.265797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-0da1b4ae-9cef-4f48-8515-19d1497af529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:19.298571 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:19.334127 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df16df9-d10b-4245-89e2-e9a7b6b8073d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:19.363719 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 310/592] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:19.375559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11842199-2e88-4ae7-ad64-c9255c65d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:19.376252 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11842199-2e88-4ae7-ad64-c9255c65d88c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:19.376540 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11842199-2e88-4ae7-ad64-c9255c65d88c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:19.376818 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11842199-2e88-4ae7-ad64-c9255c65d88c None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:19.377660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11842199-2e88-4ae7-ad64-c9255c65d88c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:19.377973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11842199-2e88-4ae7-ad64-c9255c65d88c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:19.379445 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11842199-2e88-4ae7-ad64-c9255c65d88c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:19.385894 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1b4ae-9cef-4f48-8515-19d1497af529 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:19.400684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 283/593] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 14:16:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:19.407582 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11842199-2e88-4ae7-ad64-c9255c65d88c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:19.434258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:19.508716 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1b4ae-9cef-4f48-8515-19d1497af529 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:19.519339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11842199-2e88-4ae7-ad64-c9255c65d88c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:19.549595 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0c013-76cb-421a-9974-2f8e8e6fc0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:19.551004 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0c013-76cb-421a-9974-2f8e8e6fc0da None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:19.551522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0c013-76cb-421a-9974-2f8e8e6fc0da None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:19.551998 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0c013-76cb-421a-9974-2f8e8e6fc0da None admin] PATH_INFO: `/v3/roles/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:19.559306 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6068ab1-4cd1-46a2-938b-d1c248e0ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:19.560079 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6068ab1-4cd1-46a2-938b-d1c248e0ce8a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:19.560426 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6068ab1-4cd1-46a2-938b-d1c248e0ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:19.560720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6068ab1-4cd1-46a2-938b-d1c248e0ce8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:19.564510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0c013-76cb-421a-9974-2f8e8e6fc0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-2de0c013-76cb-421a-9974-2f8e8e6fc0da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:19.572864 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:19.573797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:19.575333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:19.582827 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 311/594] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:19.583967 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0c013-76cb-421a-9974-2f8e8e6fc0da None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:19.610696 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:19.636332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6068ab1-4cd1-46a2-938b-d1c248e0ce8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:19.638768 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6068ab1-4cd1-46a2-938b-d1c248e0ce8a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:19.665897 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:19.703655 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0c013-76cb-421a-9974-2f8e8e6fc0da None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:19.748984 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9f75e-3693-4966-b862-eba71114622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:19.749803 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f75e-3693-4966-b862-eba71114622e None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:19.750185 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f75e-3693-4966-b862-eba71114622e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:19.750562 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f75e-3693-4966-b862-eba71114622e None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:19.751570 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9f75e-3693-4966-b862-eba71114622e None admin] RBAC: Adding query filter params (name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:19.751980 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9f75e-3693-4966-b862-eba71114622e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:19.753564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9f75e-3693-4966-b862-eba71114622e None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:19.763557 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 312/595] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:19.768281 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 284/596] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:16:19.769335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9f75e-3693-4966-b862-eba71114622e None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:19.770406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6068ab1-4cd1-46a2-938b-d1c248e0ce8a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:19.864458 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:19.883031 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6068ab1-4cd1-46a2-938b-d1c248e0ce8a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:19.890924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9f75e-3693-4966-b862-eba71114622e None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:19.912642 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:19.925112 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc046e-bd4c-4d94-ba33-2c993cc7419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:19.926217 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc046e-bd4c-4d94-ba33-2c993cc7419f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:19.926692 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc046e-bd4c-4d94-ba33-2c993cc7419f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:19.927136 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc046e-bd4c-4d94-ba33-2c993cc7419f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:19.934216 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb6993-9448-4687-ac86-294c8bb27dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:19.935225 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb6993-9448-4687-ac86-294c8bb27dc8 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:19.935512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb6993-9448-4687-ac86-294c8bb27dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:19.935792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb6993-9448-4687-ac86-294c8bb27dc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:19.940754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc046e-bd4c-4d94-ba33-2c993cc7419f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:19.942471 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc046e-bd4c-4d94-ba33-2c993cc7419f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:19.947495 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb6993-9448-4687-ac86-294c8bb27dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:19.948954 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb6993-9448-4687-ac86-294c8bb27dc8 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-42fc046e-bd4c-4d94-ba33-2c993cc7419f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:19.962405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:19.963341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:19.964216 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:19.964216 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:19.964216 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:19.964216 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-25cb6993-9448-4687-ac86-294c8bb27dc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:19.970715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:19.971814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:19.972694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:19.972694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:19.972694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:19.972694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:19.973276 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 285/597] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:19.974826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 313/598] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:19.975671 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb6993-9448-4687-ac86-294c8bb27dc8 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:19.976100 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc046e-bd4c-4d94-ba33-2c993cc7419f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:20.084706 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc046e-bd4c-4d94-ba33-2c993cc7419f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.085311 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb6993-9448-4687-ac86-294c8bb27dc8 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.118919 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8466c4-ed6e-4ef7-87b2-ec52f0c2204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.119346 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbc903-1ad5-4e23-a653-0239594eb9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.119582 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8466c4-ed6e-4ef7-87b2-ec52f0c2204e None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.119868 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8466c4-ed6e-4ef7-87b2-ec52f0c2204e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.120012 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbc903-1ad5-4e23-a653-0239594eb9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.120146 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8466c4-ed6e-4ef7-87b2-ec52f0c2204e None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.120299 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbc903-1ad5-4e23-a653-0239594eb9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.120580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbc903-1ad5-4e23-a653-0239594eb9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.120852 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8466c4-ed6e-4ef7-87b2-ec52f0c2204e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:20.121682 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8466c4-ed6e-4ef7-87b2-ec52f0c2204e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:20.121995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbc903-1ad5-4e23-a653-0239594eb9d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:20.122425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbc903-1ad5-4e23-a653-0239594eb9d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:20.123086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8466c4-ed6e-4ef7-87b2-ec52f0c2204e None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:20.123945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbc903-1ad5-4e23-a653-0239594eb9d3 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:20.125381 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:20.134822 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 286/599] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:20.136120 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd8edd-5d43-4898-8d98-7cbb2932ec9d None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.136408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd8edd-5d43-4898-8d98-7cbb2932ec9d None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.136771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd8edd-5d43-4898-8d98-7cbb2932ec9d None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.138917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 287/600] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:20.139990 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa853b6f-4d0d-48bb-927f-0152ba134bea None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.140273 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa853b6f-4d0d-48bb-927f-0152ba134bea None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.140547 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa853b6f-4d0d-48bb-927f-0152ba134bea None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.146319 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 314/601] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:20.146460 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 288/602] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:20.146539 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbc903-1ad5-4e23-a653-0239594eb9d3 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:20.146611 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2c57-7cf6-44c0-b151-4f242c92ed18 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.146611 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2c57-7cf6-44c0-b151-4f242c92ed18 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.146611 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2c57-7cf6-44c0-b151-4f242c92ed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.162421 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-bf0a2c57-7cf6-44c0-b151-4f242c92ed18 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:20.163679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-bf0a2c57-7cf6-44c0-b151-4f242c92ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:20.190899 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:20.232304 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 289/603] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:20.233566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674a68-bf9d-499c-bcea-14bca75bed8f None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.234044 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674a68-bf9d-499c-bcea-14bca75bed8f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.234169 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674a68-bf9d-499c-bcea-14bca75bed8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.249137 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbc903-1ad5-4e23-a653-0239594eb9d3 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.261518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-bc674a68-bf9d-499c-bcea-14bca75bed8f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:20.263343 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-bc674a68-bf9d-499c-bcea-14bca75bed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:20.285674 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613cc4-3644-4d95-a428-ceeff102baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.286492 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613cc4-3644-4d95-a428-ceeff102baf2 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.286823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613cc4-3644-4d95-a428-ceeff102baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.287103 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef613cc4-3644-4d95-a428-ceeff102baf2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.294477 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef613cc4-3644-4d95-a428-ceeff102baf2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:20.295969 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef613cc4-3644-4d95-a428-ceeff102baf2 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-ef613cc4-3644-4d95-a428-ceeff102baf2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:20.310780 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:20.311763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 315/604] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:16:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:20.312848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613cc4-3644-4d95-a428-ceeff102baf2 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:20.349251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 290/605] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 14:16:20.349911 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc674a68-bf9d-499c-bcea-14bca75bed8f None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:20.374874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:20.420373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef613cc4-3644-4d95-a428-ceeff102baf2 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.445640 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:20.452645 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc674a68-bf9d-499c-bcea-14bca75bed8f None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.456037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f294ceb-5a51-423a-9d7d-35841d2b6302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.456826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f294ceb-5a51-423a-9d7d-35841d2b6302 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.457108 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f294ceb-5a51-423a-9d7d-35841d2b6302 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.457382 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f294ceb-5a51-423a-9d7d-35841d2b6302 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.464075 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f294ceb-5a51-423a-9d7d-35841d2b6302 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:20.466117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f294ceb-5a51-423a-9d7d-35841d2b6302 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-7f294ceb-5a51-423a-9d7d-35841d2b6302 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:20.481037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:20.481926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:20.482845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:20.482845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:20.482845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:20.482845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:20.482845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:20.482845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:20.482845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:20.482845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:20.482845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 316/606] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:20.483356 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f294ceb-5a51-423a-9d7d-35841d2b6302 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:20.488328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74bd26-11f4-4fd0-86a8-0b8a9fcee64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.489127 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74bd26-11f4-4fd0-86a8-0b8a9fcee64d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.489406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74bd26-11f4-4fd0-86a8-0b8a9fcee64d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.489684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74bd26-11f4-4fd0-86a8-0b8a9fcee64d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.500522 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74bd26-11f4-4fd0-86a8-0b8a9fcee64d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-ae74bd26-11f4-4fd0-86a8-0b8a9fcee64d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:20.508387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:20.509393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:20.510210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 291/607] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:20.510914 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74bd26-11f4-4fd0-86a8-0b8a9fcee64d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:20.586824 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f294ceb-5a51-423a-9d7d-35841d2b6302 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.600766 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:20.618769 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74bd26-11f4-4fd0-86a8-0b8a9fcee64d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.621377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ced03-5eba-4dd1-a69d-300568a53e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.622047 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ced03-5eba-4dd1-a69d-300568a53e3c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.622880 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ced03-5eba-4dd1-a69d-300568a53e3c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.623161 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ced03-5eba-4dd1-a69d-300568a53e3c None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.624087 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ced03-5eba-4dd1-a69d-300568a53e3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:20.624424 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ced03-5eba-4dd1-a69d-300568a53e3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:20.625905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ced03-5eba-4dd1-a69d-300568a53e3c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:20.643647 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 317/608] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 14:16:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:20.644453 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ced03-5eba-4dd1-a69d-300568a53e3c None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:20.653991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067723-ec6c-4988-b236-504b8c4f54b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.654829 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067723-ec6c-4988-b236-504b8c4f54b9 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.655111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067723-ec6c-4988-b236-504b8c4f54b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.655388 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067723-ec6c-4988-b236-504b8c4f54b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.665588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1067723-ec6c-4988-b236-504b8c4f54b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-b1067723-ec6c-4988-b236-504b8c4f54b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:20.674003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:20.675108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 292/609] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:20.675962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067723-ec6c-4988-b236-504b8c4f54b9 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:20.698210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:20.749360 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ced03-5eba-4dd1-a69d-300568a53e3c None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.783488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27633b9a-6b63-4594-8250-361e33e1770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.784045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067723-ec6c-4988-b236-504b8c4f54b9 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.784151 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27633b9a-6b63-4594-8250-361e33e1770a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.784407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27633b9a-6b63-4594-8250-361e33e1770a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.784680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27633b9a-6b63-4594-8250-361e33e1770a None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.785466 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27633b9a-6b63-4594-8250-361e33e1770a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:20.785772 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27633b9a-6b63-4594-8250-361e33e1770a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:20.787249 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27633b9a-6b63-4594-8250-361e33e1770a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:20.799211 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 318/610] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:20.799823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27633b9a-6b63-4594-8250-361e33e1770a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:20.820811 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba41de-9926-4e97-b487-c1c1fd6d81a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.821480 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba41de-9926-4e97-b487-c1c1fd6d81a2 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.821761 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba41de-9926-4e97-b487-c1c1fd6d81a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.822035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba41de-9926-4e97-b487-c1c1fd6d81a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.822804 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba41de-9926-4e97-b487-c1c1fd6d81a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:20.823111 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba41de-9926-4e97-b487-c1c1fd6d81a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:20.824655 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba41de-9926-4e97-b487-c1c1fd6d81a2 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:20.832524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 293/611] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:20.833299 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba41de-9926-4e97-b487-c1c1fd6d81a2 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:20.837099 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:20.908382 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27633b9a-6b63-4594-8250-361e33e1770a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.914365 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:20.938328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba41de-9926-4e97-b487-c1c1fd6d81a2 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:20.942600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a035-de3e-4896-af3b-f8de9a2edf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.943279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a035-de3e-4896-af3b-f8de9a2edf6e None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.943563 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a035-de3e-4896-af3b-f8de9a2edf6e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.943840 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a035-de3e-4896-af3b-f8de9a2edf6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.972987 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448196-8146-4fe1-864a-5030fb3a2dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:20.973581 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448196-8146-4fe1-864a-5030fb3a2dc9 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:20.973865 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448196-8146-4fe1-864a-5030fb3a2dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:20.974139 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448196-8146-4fe1-864a-5030fb3a2dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:20.974917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e448196-8146-4fe1-864a-5030fb3a2dc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:20.975227 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e448196-8146-4fe1-864a-5030fb3a2dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:20.976595 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e448196-8146-4fe1-864a-5030fb3a2dc9 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:20.985420 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 294/612] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:16:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:20.986213 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448196-8146-4fe1-864a-5030fb3a2dc9 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.017030 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4a035-de3e-4896-af3b-f8de9a2edf6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:21.018614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4a035-de3e-4896-af3b-f8de9a2edf6e None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:21.049502 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:21.086088 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448196-8146-4fe1-864a-5030fb3a2dc9 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:21.117533 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 319/613] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:16:21.118367 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a035-de3e-4896-af3b-f8de9a2edf6e None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.119324 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da33d-cc24-4fa4-a3cc-c4d223c29125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:21.120082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da33d-cc24-4fa4-a3cc-c4d223c29125 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:21.120370 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da33d-cc24-4fa4-a3cc-c4d223c29125 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:21.120649 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da33d-cc24-4fa4-a3cc-c4d223c29125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:21.121656 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045da33d-cc24-4fa4-a3cc-c4d223c29125 None admin] RBAC: Adding query filter params (role.id=40519a26349f42bc93dc43425e96d7de, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=d9fa78e7e5be4bdcbd5c79a24895299d) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:21.121939 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045da33d-cc24-4fa4-a3cc-c4d223c29125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:21.123426 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045da33d-cc24-4fa4-a3cc-c4d223c29125 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:21.129603 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 295/614] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:16:20 2022] GET /identity/v3/role_assignments?user.id=d9fa78e7e5be4bdcbd5c79a24895299d&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=40519a26349f42bc93dc43425e96d7de => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:21.130685 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da33d-cc24-4fa4-a3cc-c4d223c29125 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.133216 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:21.240191 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a035-de3e-4896-af3b-f8de9a2edf6e None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:21.260804 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da33d-cc24-4fa4-a3cc-c4d223c29125 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:21.273498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:21.284100 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8b4cd-a0b6-45cb-905d-80fd23d360b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:21.287083 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8b4cd-a0b6-45cb-905d-80fd23d360b1 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:21.287083 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8b4cd-a0b6-45cb-905d-80fd23d360b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:21.287083 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8b4cd-a0b6-45cb-905d-80fd23d360b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:21.302920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728aace5-49c6-4ec0-9aff-8d8476f4291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:21.303399 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8b4cd-a0b6-45cb-905d-80fd23d360b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:21.304538 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aace5-49c6-4ec0-9aff-8d8476f4291b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:21.305001 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aace5-49c6-4ec0-9aff-8d8476f4291b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:21.305106 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8b4cd-a0b6-45cb-905d-80fd23d360b1 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:21.305538 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aace5-49c6-4ec0-9aff-8d8476f4291b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-9aa8b4cd-a0b6-45cb-905d-80fd23d360b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:21.327339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:21.328292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:21.329763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:21.329763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:21.329763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:21.329763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:21.329984 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728aace5-49c6-4ec0-9aff-8d8476f4291b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:21.330057 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 320/615] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:21.330912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8b4cd-a0b6-45cb-905d-80fd23d360b1 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.333511 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728aace5-49c6-4ec0-9aff-8d8476f4291b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-728aace5-49c6-4ec0-9aff-8d8476f4291b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:21.366124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:21.367502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:21.368377 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:21.368377 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:21.368377 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:21.368377 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:21.370115 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 296/616] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:21.370115 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728aace5-49c6-4ec0-9aff-8d8476f4291b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.453056 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:21.467638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8b4cd-a0b6-45cb-905d-80fd23d360b1 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:21.506877 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69db076-43e8-4511-a4fb-4b7532904ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:21.507610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db076-43e8-4511-a4fb-4b7532904ea0 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:21.507874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db076-43e8-4511-a4fb-4b7532904ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:21.508270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db076-43e8-4511-a4fb-4b7532904ea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:21.519882 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69db076-43e8-4511-a4fb-4b7532904ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:21.521367 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69db076-43e8-4511-a4fb-4b7532904ea0 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:21.529228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728aace5-49c6-4ec0-9aff-8d8476f4291b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-b69db076-43e8-4511-a4fb-4b7532904ea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:21.542031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:21.543695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:21.544707 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:21.544707 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:21.544707 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:21.544707 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:21.548700 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 321/617] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:21.549633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69db076-43e8-4511-a4fb-4b7532904ea0 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.568934 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee94257-f68c-474e-b922-0bb51a5f28e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:21.569946 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee94257-f68c-474e-b922-0bb51a5f28e8 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:21.570425 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee94257-f68c-474e-b922-0bb51a5f28e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:21.570912 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee94257-f68c-474e-b922-0bb51a5f28e8 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:21.571811 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee94257-f68c-474e-b922-0bb51a5f28e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:21.572311 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee94257-f68c-474e-b922-0bb51a5f28e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:21.573882 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee94257-f68c-474e-b922-0bb51a5f28e8 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:21.587406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 297/618] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:21.588563 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee94257-f68c-474e-b922-0bb51a5f28e8 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.597827 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:21.682171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69db076-43e8-4511-a4fb-4b7532904ea0 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:21.713568 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee94257-f68c-474e-b922-0bb51a5f28e8 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:21.717591 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb5626-5d7e-4668-ae6f-14d9672e9639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:21.718255 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5626-5d7e-4668-ae6f-14d9672e9639 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:21.718542 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5626-5d7e-4668-ae6f-14d9672e9639 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:21.718865 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb5626-5d7e-4668-ae6f-14d9672e9639 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:21.719597 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb5626-5d7e-4668-ae6f-14d9672e9639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:21.719907 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb5626-5d7e-4668-ae6f-14d9672e9639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:21.721297 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb5626-5d7e-4668-ae6f-14d9672e9639 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:21.728836 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:21.738366 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 322/619] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:21.738366 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb5626-5d7e-4668-ae6f-14d9672e9639 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.752467 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c6b5c-bf11-47f6-bcec-31e4a2fdd34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:21.752467 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c6b5c-bf11-47f6-bcec-31e4a2fdd34e None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:21.752467 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c6b5c-bf11-47f6-bcec-31e4a2fdd34e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:21.752467 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c6b5c-bf11-47f6-bcec-31e4a2fdd34e None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:21.752973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c6b5c-bf11-47f6-bcec-31e4a2fdd34e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:21.753241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c6b5c-bf11-47f6-bcec-31e4a2fdd34e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:21.754628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c6b5c-bf11-47f6-bcec-31e4a2fdd34e None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:21.771458 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 298/620] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:21.771458 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c6b5c-bf11-47f6-bcec-31e4a2fdd34e None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.849428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:21.856485 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb5626-5d7e-4668-ae6f-14d9672e9639 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:21.876365 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c6b5c-bf11-47f6-bcec-31e4a2fdd34e None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:21.900904 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1609ca4-5c88-4a1a-aee9-17cf6fecd916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:21.901958 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609ca4-5c88-4a1a-aee9-17cf6fecd916 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:21.903145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609ca4-5c88-4a1a-aee9-17cf6fecd916 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:21.903495 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609ca4-5c88-4a1a-aee9-17cf6fecd916 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:21.911343 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1609ca4-5c88-4a1a-aee9-17cf6fecd916 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:21.912458 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d55624-2e45-4b69-a87f-6062dc0ec2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:21.912800 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1609ca4-5c88-4a1a-aee9-17cf6fecd916 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:21.913401 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d55624-2e45-4b69-a87f-6062dc0ec2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:21.913720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d55624-2e45-4b69-a87f-6062dc0ec2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:21.914067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d55624-2e45-4b69-a87f-6062dc0ec2a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:21.921951 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d55624-2e45-4b69-a87f-6062dc0ec2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:21.923530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d55624-2e45-4b69-a87f-6062dc0ec2a6 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-c1609ca4-5c88-4a1a-aee9-17cf6fecd916 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:21.927912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:21.928814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:21.929741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 323/621] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:16:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:21.930347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1609ca4-5c88-4a1a-aee9-17cf6fecd916 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-b8d55624-2e45-4b69-a87f-6062dc0ec2a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:21.942791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:21.943735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:21.944651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 299/622] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:16:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:21.946258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d55624-2e45-4b69-a87f-6062dc0ec2a6 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:21.984301 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:22.045425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1609ca4-5c88-4a1a-aee9-17cf6fecd916 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:22.053883 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d55624-2e45-4b69-a87f-6062dc0ec2a6 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:22.085189 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f3f20-ecfb-4a82-bfce-8893968b4c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:22.085985 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f3f20-ecfb-4a82-bfce-8893968b4c6f None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:22.086309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f3f20-ecfb-4a82-bfce-8893968b4c6f None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:22.086543 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f3f20-ecfb-4a82-bfce-8893968b4c6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:22.093349 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345097-8e31-44fb-8c84-90487bc47e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:22.094911 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345097-8e31-44fb-8c84-90487bc47e28 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:22.094911 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345097-8e31-44fb-8c84-90487bc47e28 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:22.094911 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345097-8e31-44fb-8c84-90487bc47e28 None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:22.095685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f3f20-ecfb-4a82-bfce-8893968b4c6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:22.095823 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345097-8e31-44fb-8c84-90487bc47e28 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:22.096190 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345097-8e31-44fb-8c84-90487bc47e28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:22.097479 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f3f20-ecfb-4a82-bfce-8893968b4c6f None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:22.097743 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345097-8e31-44fb-8c84-90487bc47e28 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-428f3f20-ecfb-4a82-bfce-8893968b4c6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:22.112818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:22.113942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:22.115076 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:22.115076 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:22.115076 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:22.115076 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:22.115076 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:22.115076 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:22.115076 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:22.115076 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:22.124727 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 324/623] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:22.124727 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f3f20-ecfb-4a82-bfce-8893968b4c6f None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:22.124904 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 300/624] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Jun 2 14:16:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:22.129778 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345097-8e31-44fb-8c84-90487bc47e28 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:22.146087 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:22.230628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:22.231676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f3f20-ecfb-4a82-bfce-8893968b4c6f None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:22.240250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345097-8e31-44fb-8c84-90487bc47e28 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:22.268043 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5d03-166f-4d6a-84e7-07be47641609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:22.268715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5d03-166f-4d6a-84e7-07be47641609 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:22.269005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5d03-166f-4d6a-84e7-07be47641609 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:22.269281 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5d03-166f-4d6a-84e7-07be47641609 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:22.270125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb5d03-166f-4d6a-84e7-07be47641609 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:22.270434 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb5d03-166f-4d6a-84e7-07be47641609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:22.271976 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb5d03-166f-4d6a-84e7-07be47641609 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:22.282396 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335ee49-f8e6-42a2-8749-7aa3af834454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:22.283090 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335ee49-f8e6-42a2-8749-7aa3af834454 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:22.283372 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335ee49-f8e6-42a2-8749-7aa3af834454 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:22.283645 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335ee49-f8e6-42a2-8749-7aa3af834454 None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:22.284427 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335ee49-f8e6-42a2-8749-7aa3af834454 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:22.284737 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335ee49-f8e6-42a2-8749-7aa3af834454 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:22.286158 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335ee49-f8e6-42a2-8749-7aa3af834454 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:22.294673 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 325/625] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Jun 2 14:16:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:22.295365 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5d03-166f-4d6a-84e7-07be47641609 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:22.298971 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 301/626] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:22.299736 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335ee49-f8e6-42a2-8749-7aa3af834454 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:22.382408 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:22.407121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335ee49-f8e6-42a2-8749-7aa3af834454 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:22.412208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5d03-166f-4d6a-84e7-07be47641609 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:22.441427 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2309ea-9e39-40d5-9875-0c7118383dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:22.442072 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2309ea-9e39-40d5-9875-0c7118383dff None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:22.442353 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2309ea-9e39-40d5-9875-0c7118383dff None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:22.442661 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2309ea-9e39-40d5-9875-0c7118383dff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:22.448647 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf12197-2e51-4240-81a5-48e7b63f782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:22.449952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf12197-2e51-4240-81a5-48e7b63f782c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:22.450236 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf12197-2e51-4240-81a5-48e7b63f782c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:22.450513 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf12197-2e51-4240-81a5-48e7b63f782c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:22.467185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:22.518560 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2309ea-9e39-40d5-9875-0c7118383dff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:22.520198 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2309ea-9e39-40d5-9875-0c7118383dff None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:22.524682 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf12197-2e51-4240-81a5-48e7b63f782c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:22.526146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf12197-2e51-4240-81a5-48e7b63f782c None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:22.606852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:22.625753 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 302/627] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:16:22.626927 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2309ea-9e39-40d5-9875-0c7118383dff None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:22.642681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 326/628] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:16:22.642681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf12197-2e51-4240-81a5-48e7b63f782c None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:22.694056 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:22.744102 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2309ea-9e39-40d5-9875-0c7118383dff None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:22.748570 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf12197-2e51-4240-81a5-48e7b63f782c None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:22.781563 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e56c0-b3b8-4014-984d-f67bfa5ef542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:22.782354 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e56c0-b3b8-4014-984d-f67bfa5ef542 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:22.782779 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e56c0-b3b8-4014-984d-f67bfa5ef542 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:22.783131 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e56c0-b3b8-4014-984d-f67bfa5ef542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:22.784135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e56c0-b3b8-4014-984d-f67bfa5ef542 None admin] RBAC: Adding query filter params (role.id=40519a26349f42bc93dc43425e96d7de, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=45eae0d918d5451dab9283e2826ffdb9) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:22.784519 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e56c0-b3b8-4014-984d-f67bfa5ef542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:22.786025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e56c0-b3b8-4014-984d-f67bfa5ef542 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:22.788107 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238460-bd8f-4b50-95bc-bd8abfc06f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:22.788994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238460-bd8f-4b50-95bc-bd8abfc06f8a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:22.789398 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238460-bd8f-4b50-95bc-bd8abfc06f8a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:22.789777 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238460-bd8f-4b50-95bc-bd8abfc06f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:22.801659 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92238460-bd8f-4b50-95bc-bd8abfc06f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:22.803002 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 303/629] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:16:22 2022] GET /identity/v3/role_assignments?user.id=45eae0d918d5451dab9283e2826ffdb9&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=40519a26349f42bc93dc43425e96d7de => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:22.803467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92238460-bd8f-4b50-95bc-bd8abfc06f8a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:22.803816 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e56c0-b3b8-4014-984d-f67bfa5ef542 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-92238460-bd8f-4b50-95bc-bd8abfc06f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:22.824970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:22.826141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:22.827451 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:22.827451 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:22.827451 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:22.827451 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:22.829096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 327/630] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:22.834081 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238460-bd8f-4b50-95bc-bd8abfc06f8a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:22.867667 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:22.966412 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e56c0-b3b8-4014-984d-f67bfa5ef542 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:22.968218 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238460-bd8f-4b50-95bc-bd8abfc06f8a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:22.990488 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:23.013533 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c49b5-5d9c-4419-910d-113add0882e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:23.014075 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c060d0e-7f46-4d18-b79e-c378fce2a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:23.014911 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060d0e-7f46-4d18-b79e-c378fce2a13d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.015024 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c49b5-5d9c-4419-910d-113add0882e7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.015199 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060d0e-7f46-4d18-b79e-c378fce2a13d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.015365 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c49b5-5d9c-4419-910d-113add0882e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.015467 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c060d0e-7f46-4d18-b79e-c378fce2a13d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.016018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c49b5-5d9c-4419-910d-113add0882e7 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.016551 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c49b5-5d9c-4419-910d-113add0882e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:23.016932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c49b5-5d9c-4419-910d-113add0882e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:23.018445 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c49b5-5d9c-4419-910d-113add0882e7 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:23.027952 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c060d0e-7f46-4d18-b79e-c378fce2a13d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:23.030412 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c060d0e-7f46-4d18-b79e-c378fce2a13d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:23.038508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 328/631] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:23.038945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c49b5-5d9c-4419-910d-113add0882e7 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-2c060d0e-7f46-4d18-b79e-c378fce2a13d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:23.055556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:23.056679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:23.057720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:23.057720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:23.057720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:23.057720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:23.057720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 304/632] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:23.065540 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c060d0e-7f46-4d18-b79e-c378fce2a13d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:23.157367 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:23.174945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c49b5-5d9c-4419-910d-113add0882e7 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:23.211647 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c060d0e-7f46-4d18-b79e-c378fce2a13d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:23.219507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fba02-74f1-471f-9869-e0fa69e48f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:23.223371 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fba02-74f1-471f-9869-e0fa69e48f30 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.223371 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fba02-74f1-471f-9869-e0fa69e48f30 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.223371 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fba02-74f1-471f-9869-e0fa69e48f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.233884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fba02-74f1-471f-9869-e0fa69e48f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:23.235884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fba02-74f1-471f-9869-e0fa69e48f30 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-e91fba02-74f1-471f-9869-e0fa69e48f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:23.257260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:23.258426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:23.259552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:23.259552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:23.259552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:23.259552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:23.259552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:23.259552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:23.259552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:23.259552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:23.266140 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 329/633] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:23.266369 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb469e2-9f8c-490a-b0fb-25afa473729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:23.266369 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb469e2-9f8c-490a-b0fb-25afa473729b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.266369 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb469e2-9f8c-490a-b0fb-25afa473729b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.266369 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb469e2-9f8c-490a-b0fb-25afa473729b None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.266724 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb469e2-9f8c-490a-b0fb-25afa473729b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:23.266724 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb469e2-9f8c-490a-b0fb-25afa473729b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:23.267632 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fba02-74f1-471f-9869-e0fa69e48f30 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:23.269510 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb469e2-9f8c-490a-b0fb-25afa473729b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:23.286942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 305/634] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:23.292485 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb469e2-9f8c-490a-b0fb-25afa473729b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:23.331301 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:23.383469 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fba02-74f1-471f-9869-e0fa69e48f30 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:23.423356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb469e2-9f8c-490a-b0fb-25afa473729b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:23.428820 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d7d4-357d-4a40-abdc-5a4437557d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:23.429714 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d7d4-357d-4a40-abdc-5a4437557d2a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.430189 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d7d4-357d-4a40-abdc-5a4437557d2a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.430673 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d7d4-357d-4a40-abdc-5a4437557d2a None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.432151 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d7d4-357d-4a40-abdc-5a4437557d2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:23.432657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d7d4-357d-4a40-abdc-5a4437557d2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:23.434936 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d7d4-357d-4a40-abdc-5a4437557d2a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:23.453971 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 330/635] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:23.462424 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d7d4-357d-4a40-abdc-5a4437557d2a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:23.467982 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d58908-c541-4b6d-b63b-bc63bf75f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:23.468800 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d58908-c541-4b6d-b63b-bc63bf75f90c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.469079 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d58908-c541-4b6d-b63b-bc63bf75f90c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.469352 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d58908-c541-4b6d-b63b-bc63bf75f90c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.472984 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:23.479358 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d58908-c541-4b6d-b63b-bc63bf75f90c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:23.481891 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d58908-c541-4b6d-b63b-bc63bf75f90c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-a3d58908-c541-4b6d-b63b-bc63bf75f90c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:23.502764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:23.503898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:23.504839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:23.504839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:23.504839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:23.504839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:23.504839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:23.504839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:23.504839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:23.504839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:23.504839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 306/636] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:23.509760 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d58908-c541-4b6d-b63b-bc63bf75f90c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:23.591543 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d7d4-357d-4a40-abdc-5a4437557d2a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:23.628254 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6289f77-94da-48d9-be1e-7ffc58565bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:23.629159 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6289f77-94da-48d9-be1e-7ffc58565bf7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.629442 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6289f77-94da-48d9-be1e-7ffc58565bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.630258 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6289f77-94da-48d9-be1e-7ffc58565bf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.631132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6289f77-94da-48d9-be1e-7ffc58565bf7 None admin] RBAC: Adding query filter params (role.id=40519a26349f42bc93dc43425e96d7de, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=b1518eb388a24af9b85e968802e70237) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:23.631448 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6289f77-94da-48d9-be1e-7ffc58565bf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:23.632800 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:23.633302 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6289f77-94da-48d9-be1e-7ffc58565bf7 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:23.639990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 331/637] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:16:23 2022] GET /identity/v3/role_assignments?user.id=b1518eb388a24af9b85e968802e70237&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=40519a26349f42bc93dc43425e96d7de => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:23.649685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93234738-4d18-44ec-9534-b1f0e07ca7fb None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.649685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93234738-4d18-44ec-9534-b1f0e07ca7fb None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.649685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93234738-4d18-44ec-9534-b1f0e07ca7fb None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.649685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 332/638] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:23.649685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e67205-1e46-42a1-887d-42ba9074146c None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.649685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e67205-1e46-42a1-887d-42ba9074146c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.650118 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e67205-1e46-42a1-887d-42ba9074146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.654152 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d58908-c541-4b6d-b63b-bc63bf75f90c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:23.672711 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-49e67205-1e46-42a1-887d-42ba9074146c None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:23.674385 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-49e67205-1e46-42a1-887d-42ba9074146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:23.696387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f88a79-506c-4c66-9e13-7180e2480e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:23.697319 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f88a79-506c-4c66-9e13-7180e2480e9c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.697756 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f88a79-506c-4c66-9e13-7180e2480e9c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.698183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f88a79-506c-4c66-9e13-7180e2480e9c None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.699827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f88a79-506c-4c66-9e13-7180e2480e9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:23.700323 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f88a79-506c-4c66-9e13-7180e2480e9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:23.702031 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f88a79-506c-4c66-9e13-7180e2480e9c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:23.722684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 307/639] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:23.725889 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f88a79-506c-4c66-9e13-7180e2480e9c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:23.766543 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:23.774668 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 333/640] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:16:23.798111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e67205-1e46-42a1-887d-42ba9074146c None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:23.884598 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f88a79-506c-4c66-9e13-7180e2480e9c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:23.921368 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e67205-1e46-42a1-887d-42ba9074146c None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:23.933474 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c713d-03f4-41aa-828c-d380568e6cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:23.934988 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c713d-03f4-41aa-828c-d380568e6cd5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.935492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c713d-03f4-41aa-828c-d380568e6cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.935977 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c713d-03f4-41aa-828c-d380568e6cd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.937133 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c713d-03f4-41aa-828c-d380568e6cd5 None admin] RBAC: Adding query filter params (role.id=40519a26349f42bc93dc43425e96d7de, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=85bda15c821448e8b98ae81efb135f3c) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:23.937759 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c713d-03f4-41aa-828c-d380568e6cd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:23.939457 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c713d-03f4-41aa-828c-d380568e6cd5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:23.946988 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 308/641] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:16:23 2022] GET /identity/v3/role_assignments?user.id=85bda15c821448e8b98ae81efb135f3c&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=40519a26349f42bc93dc43425e96d7de => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:23.962304 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d61ec-5a1e-4d90-8053-ff872976c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:23.963621 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d61ec-5a1e-4d90-8053-ff872976c693 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:23.964143 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d61ec-5a1e-4d90-8053-ff872976c693 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:23.965211 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d61ec-5a1e-4d90-8053-ff872976c693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:23.979245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d61ec-5a1e-4d90-8053-ff872976c693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-a31d61ec-5a1e-4d90-8053-ff872976c693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:23.988949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:23.990063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:16:23.991003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:23.994039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 334/642] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:16:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:24.002745 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c713d-03f4-41aa-828c-d380568e6cd5 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:24.021072 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:24.127455 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c713d-03f4-41aa-828c-d380568e6cd5 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:24.170135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ca15f-e8a7-4672-8763-4fba9696a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:24.170852 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ca15f-e8a7-4672-8763-4fba9696a4ad None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:24.171151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ca15f-e8a7-4672-8763-4fba9696a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:24.171431 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ca15f-e8a7-4672-8763-4fba9696a4ad None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:24.172179 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ca15f-e8a7-4672-8763-4fba9696a4ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:24.172502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ca15f-e8a7-4672-8763-4fba9696a4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:24.174905 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ca15f-e8a7-4672-8763-4fba9696a4ad None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:24.183151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 309/643] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:16:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:24.190052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d61ec-5a1e-4d90-8053-ff872976c693 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:24.257731 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:24.303532 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d61ec-5a1e-4d90-8053-ff872976c693 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:24.339268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b25f97-119e-4ba4-8e3b-fe87de3e04d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:24.340598 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b25f97-119e-4ba4-8e3b-fe87de3e04d8 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:24.340882 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b25f97-119e-4ba4-8e3b-fe87de3e04d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:24.341241 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b25f97-119e-4ba4-8e3b-fe87de3e04d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:24.354867 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b25f97-119e-4ba4-8e3b-fe87de3e04d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:24.356697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b25f97-119e-4ba4-8e3b-fe87de3e04d8 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-50b25f97-119e-4ba4-8e3b-fe87de3e04d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:24.374694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:24.375641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:24.376527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:24.376527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:24.376527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:24.376527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:24.376527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 335/644] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:24.382947 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ca15f-e8a7-4672-8763-4fba9696a4ad None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:24.465207 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:24.494345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ca15f-e8a7-4672-8763-4fba9696a4ad None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:24.531224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92aa15-7de1-4cf0-968f-5230b6fbee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:24.532165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92aa15-7de1-4cf0-968f-5230b6fbee7a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:24.532644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92aa15-7de1-4cf0-968f-5230b6fbee7a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:24.533089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92aa15-7de1-4cf0-968f-5230b6fbee7a None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:24.533970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92aa15-7de1-4cf0-968f-5230b6fbee7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:24.534430 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92aa15-7de1-4cf0-968f-5230b6fbee7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:24.535972 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92aa15-7de1-4cf0-968f-5230b6fbee7a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:24.548998 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 310/645] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:24.554577 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b25f97-119e-4ba4-8e3b-fe87de3e04d8 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:24.664151 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b25f97-119e-4ba4-8e3b-fe87de3e04d8 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:24.677898 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:24.701181 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65f14c-a5f7-480a-91f1-e2706ed8d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:24.702239 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65f14c-a5f7-480a-91f1-e2706ed8d781 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:24.702705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65f14c-a5f7-480a-91f1-e2706ed8d781 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:24.703231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65f14c-a5f7-480a-91f1-e2706ed8d781 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:24.711609 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65f14c-a5f7-480a-91f1-e2706ed8d781 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:24.713250 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65f14c-a5f7-480a-91f1-e2706ed8d781 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-1d65f14c-a5f7-480a-91f1-e2706ed8d781 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:24.727905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:24.729039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:24.730213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:24.730213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:24.730213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:24.730213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:24.730213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:24.730213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:24.730213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:24.730213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:24.730213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:24.730213 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:24.732911 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 336/646] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 14:16:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:24.738535 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92aa15-7de1-4cf0-968f-5230b6fbee7a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:24.845458 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92aa15-7de1-4cf0-968f-5230b6fbee7a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:24.883573 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccc81a-626a-4d4f-8229-c18f4ebdcc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:24.884614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccc81a-626a-4d4f-8229-c18f4ebdcc94 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:24.893105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccc81a-626a-4d4f-8229-c18f4ebdcc94 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:24.893105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccc81a-626a-4d4f-8229-c18f4ebdcc94 None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:24.893105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccc81a-626a-4d4f-8229-c18f4ebdcc94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:24.893105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccc81a-626a-4d4f-8229-c18f4ebdcc94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:24.893105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccc81a-626a-4d4f-8229-c18f4ebdcc94 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:24.893105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:24.908370 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 311/647] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 14:16:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:24.913863 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65f14c-a5f7-480a-91f1-e2706ed8d781 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:25.022921 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65f14c-a5f7-480a-91f1-e2706ed8d781 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:25.059337 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b000d-83a9-49d5-927b-546e8ed834b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:25.059993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b000d-83a9-49d5-927b-546e8ed834b7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:25.060279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b000d-83a9-49d5-927b-546e8ed834b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:25.060557 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b000d-83a9-49d5-927b-546e8ed834b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:25.114285 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:25.130811 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b000d-83a9-49d5-927b-546e8ed834b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:25.139046 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b000d-83a9-49d5-927b-546e8ed834b7 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:25.234221 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 337/648] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 14:16:25.239695 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccc81a-626a-4d4f-8229-c18f4ebdcc94 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:25.347613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccc81a-626a-4d4f-8229-c18f4ebdcc94 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:25.354410 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b2a57-44c8-403a-9825-ce1710726325 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:25.354729 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b2a57-44c8-403a-9825-ce1710726325 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:25.355016 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b2a57-44c8-403a-9825-ce1710726325 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:25.357200 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 338/649] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:25.367450 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ee92f-839e-4f3d-82af-80421c7e742f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:25.367862 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ee92f-839e-4f3d-82af-80421c7e742f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:25.368242 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ee92f-839e-4f3d-82af-80421c7e742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:25.386308 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-435ee92f-839e-4f3d-82af-80421c7e742f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:25.387981 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-435ee92f-839e-4f3d-82af-80421c7e742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:25.391459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaca4ba-f5cb-479d-8e84-3fb879a958d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:25.392438 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca4ba-f5cb-479d-8e84-3fb879a958d6 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:25.392898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca4ba-f5cb-479d-8e84-3fb879a958d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:25.393320 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca4ba-f5cb-479d-8e84-3fb879a958d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:25.405008 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaca4ba-f5cb-479d-8e84-3fb879a958d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:25.406817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaca4ba-f5cb-479d-8e84-3fb879a958d6 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-afaca4ba-f5cb-479d-8e84-3fb879a958d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:25.425962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:25.427109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:25.428203 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:25.428203 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:25.428203 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:25.428203 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:25.430103 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 312/650] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:25.440108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaca4ba-f5cb-479d-8e84-3fb879a958d6 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:25.468052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 339/651] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:16:25.490124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:25.496375 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ee92f-839e-4f3d-82af-80421c7e742f None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:25.498574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:25.549507 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaca4ba-f5cb-479d-8e84-3fb879a958d6 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:25.587545 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad51da8-0f8f-47f9-8802-4dcf89177338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:25.588622 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51da8-0f8f-47f9-8802-4dcf89177338 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:25.589120 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51da8-0f8f-47f9-8802-4dcf89177338 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:25.589578 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51da8-0f8f-47f9-8802-4dcf89177338 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:25.590575 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad51da8-0f8f-47f9-8802-4dcf89177338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:25.591195 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad51da8-0f8f-47f9-8802-4dcf89177338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:25.592849 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad51da8-0f8f-47f9-8802-4dcf89177338 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:25.606237 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 313/652] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:25.610699 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ee92f-839e-4f3d-82af-80421c7e742f None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:25.612630 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad51da8-0f8f-47f9-8802-4dcf89177338 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:25.648163 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cba3f-b6cd-4623-9179-ecedcbad2aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:25.649017 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cba3f-b6cd-4623-9179-ecedcbad2aa1 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:25.649348 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cba3f-b6cd-4623-9179-ecedcbad2aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:25.649574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cba3f-b6cd-4623-9179-ecedcbad2aa1 None admin] PATH_INFO: `/v3/services/image` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:25.650237 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cba3f-b6cd-4623-9179-ecedcbad2aa1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:25.651701 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cba3f-b6cd-4623-9179-ecedcbad2aa1 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-855cba3f-b6cd-4623-9179-ecedcbad2aa1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:25.666498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:25.667580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 14:16:25.669406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:25.673576 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 340/653] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Jun 2 14:16:25 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:25.674676 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cba3f-b6cd-4623-9179-ecedcbad2aa1 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:25.729458 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad51da8-0f8f-47f9-8802-4dcf89177338 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:25.733031 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:25.749384 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:25.769580 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b6161-810c-49d6-a367-f1060a810902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:25.770575 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b6161-810c-49d6-a367-f1060a810902 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:25.770991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b6161-810c-49d6-a367-f1060a810902 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:25.771402 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b6161-810c-49d6-a367-f1060a810902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:25.779964 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b6161-810c-49d6-a367-f1060a810902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:25.781592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b6161-810c-49d6-a367-f1060a810902 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:25.793553 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cba3f-b6cd-4623-9179-ecedcbad2aa1 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-9d0b6161-810c-49d6-a367-f1060a810902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:25.798389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:25.799446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:25.800404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:25.800404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:25.800404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:25.800404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:25.800404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:25.800404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:25.800404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:25.800404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:25.804113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 314/654] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:25.806362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b6161-810c-49d6-a367-f1060a810902 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:25.836115 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ead01-2651-4c8e-b095-2532ac2148e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:25.837244 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ead01-2651-4c8e-b095-2532ac2148e7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:25.837728 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ead01-2651-4c8e-b095-2532ac2148e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:25.838175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ead01-2651-4c8e-b095-2532ac2148e7 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:25.839230 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ead01-2651-4c8e-b095-2532ac2148e7 None admin] RBAC: Adding query filter params (name=image) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:25.839748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ead01-2651-4c8e-b095-2532ac2148e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:25.841538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ead01-2651-4c8e-b095-2532ac2148e7 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:25.851656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 341/655] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:25.852886 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ead01-2651-4c8e-b095-2532ac2148e7 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:25.915441 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b6161-810c-49d6-a367-f1060a810902 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:25.956474 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af170b6b-776d-40b2-965c-1594845df776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:25.957513 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170b6b-776d-40b2-965c-1594845df776 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:25.957513 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170b6b-776d-40b2-965c-1594845df776 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:25.957886 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170b6b-776d-40b2-965c-1594845df776 None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:25.958812 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170b6b-776d-40b2-965c-1594845df776 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:25.959180 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170b6b-776d-40b2-965c-1594845df776 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:25.960700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170b6b-776d-40b2-965c-1594845df776 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:25.968515 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ead01-2651-4c8e-b095-2532ac2148e7 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:25.978564 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 315/656] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:25.980020 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af170b6b-776d-40b2-965c-1594845df776 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:26.001011 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:26.008117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7de9e-c848-49cb-9ec8-d2b6b9d747c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:26.008933 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:26.010080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7de9e-c848-49cb-9ec8-d2b6b9d747c0 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:26.010994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7de9e-c848-49cb-9ec8-d2b6b9d747c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:26.010994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7de9e-c848-49cb-9ec8-d2b6b9d747c0 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:26.012761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7de9e-c848-49cb-9ec8-d2b6b9d747c0 None admin] RBAC: Adding query filter params (type=image) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:26.013346 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7de9e-c848-49cb-9ec8-d2b6b9d747c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:26.015003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7de9e-c848-49cb-9ec8-d2b6b9d747c0 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:26.021334 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 342/657] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:26.096949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af170b6b-776d-40b2-965c-1594845df776 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:26.136391 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa663b75-fe67-4bca-b3b0-daa71d4a413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:26.137373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d622bf-b252-47a2-9696-d05285d7df31 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:26.137651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa663b75-fe67-4bca-b3b0-daa71d4a413b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:26.137819 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d622bf-b252-47a2-9696-d05285d7df31 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:26.137992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa663b75-fe67-4bca-b3b0-daa71d4a413b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:26.138096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d622bf-b252-47a2-9696-d05285d7df31 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:26.138245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa663b75-fe67-4bca-b3b0-daa71d4a413b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:26.139156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa663b75-fe67-4bca-b3b0-daa71d4a413b None admin] RBAC: Adding query filter params (role.id=61482861f00e45048fc1d45570c4c99b, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=d9fa78e7e5be4bdcbd5c79a24895299d) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:26.139482 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa663b75-fe67-4bca-b3b0-daa71d4a413b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:26.139801 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 343/658] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:26.141272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa663b75-fe67-4bca-b3b0-daa71d4a413b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:26.145375 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61e3bd-3a79-4984-a7e5-f10a82ffd0fe None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:26.145667 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61e3bd-3a79-4984-a7e5-f10a82ffd0fe None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:26.145938 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61e3bd-3a79-4984-a7e5-f10a82ffd0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:26.154829 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 316/659] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:16:25 2022] GET /identity/v3/role_assignments?user.id=d9fa78e7e5be4bdcbd5c79a24895299d&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=61482861f00e45048fc1d45570c4c99b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:26.164977 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-2e61e3bd-3a79-4984-a7e5-f10a82ffd0fe None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:26.166347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-2e61e3bd-3a79-4984-a7e5-f10a82ffd0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:26.257166 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 344/660] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:16:26.284159 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa663b75-fe67-4bca-b3b0-daa71d4a413b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:26.386600 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:26.399273 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa663b75-fe67-4bca-b3b0-daa71d4a413b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:26.435274 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aa98d-2279-4a89-b391-4e4b0237ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:26.436090 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa98d-2279-4a89-b391-4e4b0237ce5e None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:26.436378 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa98d-2279-4a89-b391-4e4b0237ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:26.436653 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa98d-2279-4a89-b391-4e4b0237ce5e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:26.437315 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aa98d-2279-4a89-b391-4e4b0237ce5e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:26.438732 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aa98d-2279-4a89-b391-4e4b0237ce5e None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-0f9aa98d-2279-4a89-b391-4e4b0237ce5e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:26.453151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:26.454143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:26.454991 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 317/661] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Jun 2 14:16:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:26.460323 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61e3bd-3a79-4984-a7e5-f10a82ffd0fe None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:26.525917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3779f5-e046-4c39-8c93-8b1d758fb6fc None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:26.526427 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3779f5-e046-4c39-8c93-8b1d758fb6fc None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:26.526504 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3779f5-e046-4c39-8c93-8b1d758fb6fc None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:26.528157 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 318/662] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:26.533380 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78ebd0-31a1-45a1-95af-e375836ab7b1 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:26.533749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78ebd0-31a1-45a1-95af-e375836ab7b1 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:26.534108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78ebd0-31a1-45a1-95af-e375836ab7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:26.556275 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-ab78ebd0-31a1-45a1-95af-e375836ab7b1 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:26.557602 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-ab78ebd0-31a1-45a1-95af-e375836ab7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:26.571636 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61e3bd-3a79-4984-a7e5-f10a82ffd0fe None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:26.598031 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:26.610556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0732590-a537-4f9d-ba56-3b09625b8c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:26.611776 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0732590-a537-4f9d-ba56-3b09625b8c88 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:26.612832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0732590-a537-4f9d-ba56-3b09625b8c88 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:26.613256 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0732590-a537-4f9d-ba56-3b09625b8c88 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:26.614109 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0732590-a537-4f9d-ba56-3b09625b8c88 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:26.614561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0732590-a537-4f9d-ba56-3b09625b8c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:26.616354 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0732590-a537-4f9d-ba56-3b09625b8c88 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:26.622498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 345/663] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 14:16:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:26.628067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0732590-a537-4f9d-ba56-3b09625b8c88 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:26.646823 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 319/664] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:16:26.671242 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78ebd0-31a1-45a1-95af-e375836ab7b1 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:26.755392 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0732590-a537-4f9d-ba56-3b09625b8c88 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:26.762389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:26.789540 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78ebd0-31a1-45a1-95af-e375836ab7b1 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:26.791690 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24898-31c9-4ff2-8c96-19d1507a72cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:26.793429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24898-31c9-4ff2-8c96-19d1507a72cd None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:26.793429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24898-31c9-4ff2-8c96-19d1507a72cd None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:26.793861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24898-31c9-4ff2-8c96-19d1507a72cd None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:26.794597 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24898-31c9-4ff2-8c96-19d1507a72cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:26.796578 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24898-31c9-4ff2-8c96-19d1507a72cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:26.797588 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24898-31c9-4ff2-8c96-19d1507a72cd None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:26.803565 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 346/665] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 14:16:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:26.834408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc3764-ea5a-43d4-b9f6-c0ac4581617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:26.835455 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc3764-ea5a-43d4-b9f6-c0ac4581617a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:26.835753 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc3764-ea5a-43d4-b9f6-c0ac4581617a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:26.836036 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc3764-ea5a-43d4-b9f6-c0ac4581617a None admin] PATH_INFO: `/v3/services/network` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:26.836721 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc3764-ea5a-43d4-b9f6-c0ac4581617a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:26.838214 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc3764-ea5a-43d4-b9f6-c0ac4581617a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-bfbc3764-ea5a-43d4-b9f6-c0ac4581617a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:26.852404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:26.853447 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 14:16:26.854268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:26.858948 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 320/666] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:26 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:26.860431 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24898-31c9-4ff2-8c96-19d1507a72cd None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:26.924006 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:26.983694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24898-31c9-4ff2-8c96-19d1507a72cd None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:27.025268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27a53b-0eef-463a-aa3c-e9058d010f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:27.026215 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a53b-0eef-463a-aa3c-e9058d010f0b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:27.026685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a53b-0eef-463a-aa3c-e9058d010f0b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:27.027137 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a53b-0eef-463a-aa3c-e9058d010f0b None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:27.028524 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27a53b-0eef-463a-aa3c-e9058d010f0b None admin] RBAC: Adding query filter params (name=network) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:27.028983 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27a53b-0eef-463a-aa3c-e9058d010f0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:27.030601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27a53b-0eef-463a-aa3c-e9058d010f0b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:27.035829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 347/667] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:27.041302 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc3764-ea5a-43d4-b9f6-c0ac4581617a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:27.151884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc3764-ea5a-43d4-b9f6-c0ac4581617a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:27.187655 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e3d52-2ccb-4353-9175-59d53112b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:27.188247 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3d52-2ccb-4353-9175-59d53112b3a3 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:27.188537 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3d52-2ccb-4353-9175-59d53112b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:27.188818 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3d52-2ccb-4353-9175-59d53112b3a3 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:27.189534 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e3d52-2ccb-4353-9175-59d53112b3a3 None admin] RBAC: Adding query filter params (type=network) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:27.189847 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e3d52-2ccb-4353-9175-59d53112b3a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:27.191266 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e3d52-2ccb-4353-9175-59d53112b3a3 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:27.202840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 321/668] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:28.532788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cff26-21d6-483e-a0d0-0019b6e0eb95 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:28.533316 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cff26-21d6-483e-a0d0-0019b6e0eb95 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:28.533316 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cff26-21d6-483e-a0d0-0019b6e0eb95 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:28.535009 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 348/669] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:28.540226 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866c903-4bab-4344-ae27-50446aad7b36 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:28.540616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866c903-4bab-4344-ae27-50446aad7b36 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:28.540783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866c903-4bab-4344-ae27-50446aad7b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:28.558606 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-e866c903-4bab-4344-ae27-50446aad7b36 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:28.559832 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-e866c903-4bab-4344-ae27-50446aad7b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:28.563655 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:28.612721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c43ad1-f721-46e7-920e-9ebb31080e85 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:28.613049 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c43ad1-f721-46e7-920e-9ebb31080e85 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:28.613335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c43ad1-f721-46e7-920e-9ebb31080e85 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:28.615044 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 349/670] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:28.620122 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ef5a-d6bb-4938-b801-5ea84ee7f794 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:28.620409 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ef5a-d6bb-4938-b801-5ea84ee7f794 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:28.620685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ef5a-d6bb-4938-b801-5ea84ee7f794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:28.640029 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-40e1ef5a-d6bb-4938-b801-5ea84ee7f794 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:28.641245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-40e1ef5a-d6bb-4938-b801-5ea84ee7f794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:28.642400 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 322/671] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:16:28.666502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866c903-4bab-4344-ae27-50446aad7b36 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:28.717956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 350/672] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:16:28.743293 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1ef5a-d6bb-4938-b801-5ea84ee7f794 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:28.778918 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866c903-4bab-4344-ae27-50446aad7b36 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:28.805425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:28.825521 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7e9fd-8e92-4b26-9cda-088b936fcb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:28.826553 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7e9fd-8e92-4b26-9cda-088b936fcb02 None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:28.827493 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7e9fd-8e92-4b26-9cda-088b936fcb02 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:28.827919 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7e9fd-8e92-4b26-9cda-088b936fcb02 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:28.829173 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7e9fd-8e92-4b26-9cda-088b936fcb02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:28.831919 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7e9fd-8e92-4b26-9cda-088b936fcb02 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:28.863434 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1ef5a-d6bb-4938-b801-5ea84ee7f794 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:28.910414 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608af73-2a42-4fd0-9739-863bd457f28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:28.911278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608af73-2a42-4fd0-9739-863bd457f28c None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:28.911615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608af73-2a42-4fd0-9739-863bd457f28c None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:28.911845 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608af73-2a42-4fd0-9739-863bd457f28c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:28.923693 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608af73-2a42-4fd0-9739-863bd457f28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-a608af73-2a42-4fd0-9739-863bd457f28c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:28.931372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:28.932278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:28.933128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 351/673] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:28.939750 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608af73-2a42-4fd0-9739-863bd457f28c None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:28.942955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:28.951221 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 323/674] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 14:16:28 2022] POST /identity/v3/services => generated 242 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:16:29.065343 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608af73-2a42-4fd0-9739-863bd457f28c None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:29.074844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:29.122852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c2185-668b-4a44-b344-d1a7f1809518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:29.123834 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c2185-668b-4a44-b344-d1a7f1809518 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.124270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c2185-668b-4a44-b344-d1a7f1809518 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.124765 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c2185-668b-4a44-b344-d1a7f1809518 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.125688 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c2185-668b-4a44-b344-d1a7f1809518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:29.126151 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c2185-668b-4a44-b344-d1a7f1809518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:29.127759 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c2185-668b-4a44-b344-d1a7f1809518 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:29.139732 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 352/675] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:16:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:29.146419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7e9fd-8e92-4b26-9cda-088b936fcb02 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:29.264025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7e9fd-8e92-4b26-9cda-088b936fcb02 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:29.264511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5764e57-8ac9-4fd9-b351-4857ecce1d6a None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.265037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5764e57-8ac9-4fd9-b351-4857ecce1d6a None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.265523 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5764e57-8ac9-4fd9-b351-4857ecce1d6a None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.268884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 353/676] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:29.274237 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6232a-f744-4593-ab00-c941884fdf41 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.274537 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6232a-f744-4593-ab00-c941884fdf41 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.278684 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6232a-f744-4593-ab00-c941884fdf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.293258 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-d7a6232a-f744-4593-ab00-c941884fdf41 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:29.294555 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-d7a6232a-f744-4593-ab00-c941884fdf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:29.303068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393c43c-3da7-4b9b-a02c-a436980ca3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:29.303987 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393c43c-3da7-4b9b-a02c-a436980ca3ba None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.304268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393c43c-3da7-4b9b-a02c-a436980ca3ba None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.304547 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393c43c-3da7-4b9b-a02c-a436980ca3ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.316564 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393c43c-3da7-4b9b-a02c-a436980ca3ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:29.318102 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393c43c-3da7-4b9b-a02c-a436980ca3ba None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-4393c43c-3da7-4b9b-a02c-a436980ca3ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:29.336872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:29.337784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:29.338701 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:29.338701 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:29.338701 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:29.338701 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:29.338701 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 324/677] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:29.344420 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393c43c-3da7-4b9b-a02c-a436980ca3ba None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:29.370418 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 354/678] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:29 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:16:29.394798 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6232a-f744-4593-ab00-c941884fdf41 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:29.412800 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:29.468919 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393c43c-3da7-4b9b-a02c-a436980ca3ba None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:29.507310 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3cfb1-180e-47fb-bef4-70e20a70d4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:29.508075 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3cfb1-180e-47fb-bef4-70e20a70d4eb None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.508431 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3cfb1-180e-47fb-bef4-70e20a70d4eb None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.508780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3cfb1-180e-47fb-bef4-70e20a70d4eb None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.509579 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3cfb1-180e-47fb-bef4-70e20a70d4eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:29.509955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3cfb1-180e-47fb-bef4-70e20a70d4eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:29.512028 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3cfb1-180e-47fb-bef4-70e20a70d4eb None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:29.512746 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:29.524331 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6232a-f744-4593-ab00-c941884fdf41 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:29.528014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 325/679] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:29.533141 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3cfb1-180e-47fb-bef4-70e20a70d4eb None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:29.566142 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed173e02-ce30-4c86-8242-da52de1122bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:29.567680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed173e02-ce30-4c86-8242-da52de1122bd None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.568548 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed173e02-ce30-4c86-8242-da52de1122bd None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.568829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed173e02-ce30-4c86-8242-da52de1122bd None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.569570 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed173e02-ce30-4c86-8242-da52de1122bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:29.571030 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed173e02-ce30-4c86-8242-da52de1122bd None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:29.646902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3cfb1-180e-47fb-bef4-70e20a70d4eb None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:29.647938 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 355/680] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 14:16:29 2022] POST /identity/v3/services => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:16:29.656417 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087daee5-ac70-4549-8bc1-ed789baeccac None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.656738 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087daee5-ac70-4549-8bc1-ed789baeccac None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.657059 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087daee5-ac70-4549-8bc1-ed789baeccac None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.658840 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 356/681] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:29.664873 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b909a-cc5d-424b-a520-4c6b807d620f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.665178 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b909a-cc5d-424b-a520-4c6b807d620f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.665429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b909a-cc5d-424b-a520-4c6b807d620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.672632 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:29.688719 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-d80b909a-cc5d-424b-a520-4c6b807d620f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:29.690238 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-d80b909a-cc5d-424b-a520-4c6b807d620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:29.707676 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601eec9-a17c-4c6b-a752-c3fecfefe8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:29.709125 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601eec9-a17c-4c6b-a752-c3fecfefe8e5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.710125 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601eec9-a17c-4c6b-a752-c3fecfefe8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.710255 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601eec9-a17c-4c6b-a752-c3fecfefe8e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.721015 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601eec9-a17c-4c6b-a752-c3fecfefe8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:29.722831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601eec9-a17c-4c6b-a752-c3fecfefe8e5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-5601eec9-a17c-4c6b-a752-c3fecfefe8e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:29.740799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:29.741944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:29.743168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 326/682] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 14:16:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:29.750851 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601eec9-a17c-4c6b-a752-c3fecfefe8e5 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:29.790939 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 357/683] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:29 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 14:16:29.809735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b909a-cc5d-424b-a520-4c6b807d620f None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:29.867487 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601eec9-a17c-4c6b-a752-c3fecfefe8e5 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:29.910611 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:29.913507 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f10e29-42a9-4d5b-bd37-65b28c56026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:29.914602 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f10e29-42a9-4d5b-bd37-65b28c56026d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.914602 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f10e29-42a9-4d5b-bd37-65b28c56026d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.914816 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f10e29-42a9-4d5b-bd37-65b28c56026d None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.915730 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f10e29-42a9-4d5b-bd37-65b28c56026d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:29.916040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f10e29-42a9-4d5b-bd37-65b28c56026d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:29.918212 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f10e29-42a9-4d5b-bd37-65b28c56026d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:29.936616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b909a-cc5d-424b-a520-4c6b807d620f None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:29.941048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 327/684] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 14:16:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:29.946737 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f10e29-42a9-4d5b-bd37-65b28c56026d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:29.975830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ac719-ec44-4041-b36f-487f44fc8d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:29.976499 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ac719-ec44-4041-b36f-487f44fc8d91 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:29.976785 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ac719-ec44-4041-b36f-487f44fc8d91 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:29.977063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ac719-ec44-4041-b36f-487f44fc8d91 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:29.977808 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ac719-ec44-4041-b36f-487f44fc8d91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:29.979239 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ac719-ec44-4041-b36f-487f44fc8d91 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:29.980659 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:30.052385 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f10e29-42a9-4d5b-bd37-65b28c56026d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:30.085618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 358/685] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 14:16:29 2022] POST /identity/v3/services => generated 240 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:30.102586 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8153a7-02cf-4cb1-a6a0-4711447b4cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:30.103487 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8153a7-02cf-4cb1-a6a0-4711447b4cf8 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:30.103777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8153a7-02cf-4cb1-a6a0-4711447b4cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:30.104056 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8153a7-02cf-4cb1-a6a0-4711447b4cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:30.117468 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8153a7-02cf-4cb1-a6a0-4711447b4cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:30.119055 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8153a7-02cf-4cb1-a6a0-4711447b4cf8 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-2f8153a7-02cf-4cb1-a6a0-4711447b4cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:30.140128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:30.142561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:30.143558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:30.143558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:30.143558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:30.143558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:30.143558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 328/686] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:30.147335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ac719-ec44-4041-b36f-487f44fc8d91 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:30.263870 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ac719-ec44-4041-b36f-487f44fc8d91 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:30.302514 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d38d08-6fe7-4b21-8688-54fd21b4cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:30.303227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d38d08-6fe7-4b21-8688-54fd21b4cf5d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:30.303509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d38d08-6fe7-4b21-8688-54fd21b4cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:30.303784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d38d08-6fe7-4b21-8688-54fd21b4cf5d None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:30.304522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d38d08-6fe7-4b21-8688-54fd21b4cf5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:30.304829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d38d08-6fe7-4b21-8688-54fd21b4cf5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:30.306231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d38d08-6fe7-4b21-8688-54fd21b4cf5d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:30.320928 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 359/687] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:30.326174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8153a7-02cf-4cb1-a6a0-4711447b4cf8 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:30.418243 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:30.439671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8153a7-02cf-4cb1-a6a0-4711447b4cf8 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:30.475060 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e8569-46d4-48a3-ac64-e8457d0a6bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:30.475906 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e8569-46d4-48a3-ac64-e8457d0a6bba None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:30.476189 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e8569-46d4-48a3-ac64-e8457d0a6bba None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:30.476463 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e8569-46d4-48a3-ac64-e8457d0a6bba None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:30.483958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e8569-46d4-48a3-ac64-e8457d0a6bba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:30.485406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e8569-46d4-48a3-ac64-e8457d0a6bba None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-a76e8569-46d4-48a3-ac64-e8457d0a6bba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:30.499920 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:30.500848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:30.502134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:30.502134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:30.502134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:30.502134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:30.502134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:30.502134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:30.502134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:30.502134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:30.502134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 329/688] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:30.507377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d38d08-6fe7-4b21-8688-54fd21b4cf5d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:30.512223 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:30.623991 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d38d08-6fe7-4b21-8688-54fd21b4cf5d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:30.664231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924e290-d312-49ef-8911-13f161705097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:30.665210 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924e290-d312-49ef-8911-13f161705097 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:30.665670 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924e290-d312-49ef-8911-13f161705097 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:30.666118 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924e290-d312-49ef-8911-13f161705097 None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:30.667182 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924e290-d312-49ef-8911-13f161705097 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:30.667702 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924e290-d312-49ef-8911-13f161705097 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:30.669991 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924e290-d312-49ef-8911-13f161705097 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:30.682211 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 360/689] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:30.688798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e8569-46d4-48a3-ac64-e8457d0a6bba None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:30.795130 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e8569-46d4-48a3-ac64-e8457d0a6bba None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:30.839633 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f4ffb-8438-48c4-9a84-4c98e2cab187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:30.841399 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f4ffb-8438-48c4-9a84-4c98e2cab187 None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:30.841900 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f4ffb-8438-48c4-9a84-4c98e2cab187 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:30.842361 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f4ffb-8438-48c4-9a84-4c98e2cab187 None admin] PATH_INFO: `/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/d9fa78e7e5be4bdcbd5c79a24895299d/roles/61482861f00e45048fc1d45570c4c99b` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:30.844611 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f4ffb-8438-48c4-9a84-4c98e2cab187 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5992534cc13499cb1ae95958d96ca9c, user_id=d9fa78e7e5be4bdcbd5c79a24895299d, role_id=61482861f00e45048fc1d45570c4c99b)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:30.846367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f4ffb-8438-48c4-9a84-4c98e2cab187 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:30.848817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:30.929644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 330/690] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:16:30 2022] PUT /identity/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/d9fa78e7e5be4bdcbd5c79a24895299d/roles/61482861f00e45048fc1d45570c4c99b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:16:31.473590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765d688-fdfb-44c5-a205-aa74378b53ad None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:31.474238 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765d688-fdfb-44c5-a205-aa74378b53ad None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:31.474804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765d688-fdfb-44c5-a205-aa74378b53ad None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:31.476594 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 361/691] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:31.483052 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8636c-52cf-456d-a6eb-ced3622e69a9 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:31.483602 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8636c-52cf-456d-a6eb-ced3622e69a9 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:31.484078 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8636c-52cf-456d-a6eb-ced3622e69a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:31.502236 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-80f8636c-52cf-456d-a6eb-ced3622e69a9 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:31.503460 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-80f8636c-52cf-456d-a6eb-ced3622e69a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:31.575575 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 331/692] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:31.599502 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765d688-fdfb-44c5-a205-aa74378b53ad None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:31.665884 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:31.711085 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765d688-fdfb-44c5-a205-aa74378b53ad None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:31.748479 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabc323-2a3e-4eee-a61b-18c0577f6b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:31.749511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabc323-2a3e-4eee-a61b-18c0577f6b15 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:31.749942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabc323-2a3e-4eee-a61b-18c0577f6b15 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:31.750364 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabc323-2a3e-4eee-a61b-18c0577f6b15 None admin] PATH_INFO: `/v3/services/image` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:31.751217 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabc323-2a3e-4eee-a61b-18c0577f6b15 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:31.752737 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabc323-2a3e-4eee-a61b-18c0577f6b15 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-4cabc323-2a3e-4eee-a61b-18c0577f6b15 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:31.765781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:31.767077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 14:16:31.768080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:31.770593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 362/693] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Jun 2 14:16:31 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:31.781138 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8636c-52cf-456d-a6eb-ced3622e69a9 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:31.898134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8636c-52cf-456d-a6eb-ced3622e69a9 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:31.923233 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:31.934867 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477b1ba-28bb-4842-89aa-96d631d346f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:31.936446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b1ba-28bb-4842-89aa-96d631d346f5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:31.936446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b1ba-28bb-4842-89aa-96d631d346f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:31.936446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b1ba-28bb-4842-89aa-96d631d346f5 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:31.936894 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477b1ba-28bb-4842-89aa-96d631d346f5 None admin] RBAC: Adding query filter params (name=image) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:31.937200 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477b1ba-28bb-4842-89aa-96d631d346f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:31.938576 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477b1ba-28bb-4842-89aa-96d631d346f5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:31.943732 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 332/694] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:31.949602 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabc323-2a3e-4eee-a61b-18c0577f6b15 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:32.054685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabc323-2a3e-4eee-a61b-18c0577f6b15 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:32.083086 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:32.091829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447eb7-5f74-44aa-815d-1e6bb2c6bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:32.092502 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447eb7-5f74-44aa-815d-1e6bb2c6bde9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.092786 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447eb7-5f74-44aa-815d-1e6bb2c6bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.093063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447eb7-5f74-44aa-815d-1e6bb2c6bde9 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.093772 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7447eb7-5f74-44aa-815d-1e6bb2c6bde9 None admin] RBAC: Adding query filter params (type=image) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:32.094189 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7447eb7-5f74-44aa-815d-1e6bb2c6bde9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:32.095547 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7447eb7-5f74-44aa-815d-1e6bb2c6bde9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:32.101198 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 363/695] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:32.107855 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477b1ba-28bb-4842-89aa-96d631d346f5 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:32.212936 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477b1ba-28bb-4842-89aa-96d631d346f5 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:32.226432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216658fe-ed59-4f83-b07f-395f3ecf38a3 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.227071 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216658fe-ed59-4f83-b07f-395f3ecf38a3 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.227671 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216658fe-ed59-4f83-b07f-395f3ecf38a3 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.229624 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 364/696] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:32.235251 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d1c90-9974-4201-a40e-6102e0b0d631 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.235833 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d1c90-9974-4201-a40e-6102e0b0d631 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.236313 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d1c90-9974-4201-a40e-6102e0b0d631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.251997 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6146d-a663-4e2a-a9a4-e959b6823bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:32.253042 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6146d-a663-4e2a-a9a4-e959b6823bb4 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.253529 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6146d-a663-4e2a-a9a4-e959b6823bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.254034 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6146d-a663-4e2a-a9a4-e959b6823bb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.255448 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6146d-a663-4e2a-a9a4-e959b6823bb4 None admin] RBAC: Adding query filter params (interface=public, service_id=e20a6a03169d48a4a5dd1bc5deee3fca, region_id=RegionOne) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:32.255572 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-1e6d1c90-9974-4201-a40e-6102e0b0d631 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:32.256128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6146d-a663-4e2a-a9a4-e959b6823bb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:32.256800 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-1e6d1c90-9974-4201-a40e-6102e0b0d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:32.257784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6146d-a663-4e2a-a9a4-e959b6823bb4 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:32.267648 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 333/697] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 14:16:32 2022] GET /identity/v3/endpoints?service_id=e20a6a03169d48a4a5dd1bc5deee3fca&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:32.273022 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6146d-a663-4e2a-a9a4-e959b6823bb4 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:32.345457 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 365/698] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:32 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 14:16:32.346301 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:32.375305 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d1c90-9974-4201-a40e-6102e0b0d631 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:32.417675 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6146d-a663-4e2a-a9a4-e959b6823bb4 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:32.463182 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a116e-c533-4967-9973-f1ba70149f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:32.466217 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a116e-c533-4967-9973-f1ba70149f1b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.466719 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a116e-c533-4967-9973-f1ba70149f1b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.467192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a116e-c533-4967-9973-f1ba70149f1b None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.468046 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a116e-c533-4967-9973-f1ba70149f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:32.469598 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a116e-c533-4967-9973-f1ba70149f1b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:32.477312 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 334/699] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 14:16:32 2022] GET /identity/v3/services => generated 1002 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:16:32.506499 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d1c90-9974-4201-a40e-6102e0b0d631 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:32.534931 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:32.549119 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dced3f-c08f-4571-9ebe-f17360f32bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:32.550378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dced3f-c08f-4571-9ebe-f17360f32bc7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.550872 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dced3f-c08f-4571-9ebe-f17360f32bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.551330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dced3f-c08f-4571-9ebe-f17360f32bc7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.552185 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dced3f-c08f-4571-9ebe-f17360f32bc7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:32.553992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dced3f-c08f-4571-9ebe-f17360f32bc7 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-f4dced3f-c08f-4571-9ebe-f17360f32bc7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:32.568560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:32.569538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 14:16:32.570361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:32.573041 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 366/700] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Jun 2 14:16:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:32.579932 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a116e-c533-4967-9973-f1ba70149f1b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:32.624027 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78af086-c535-4223-8b8b-4f80e0dc0646 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.624318 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78af086-c535-4223-8b8b-4f80e0dc0646 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.624602 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78af086-c535-4223-8b8b-4f80e0dc0646 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.626320 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 367/701] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:32.632330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67d21f-1090-4906-8c17-b0a5f94762cb None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.632623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67d21f-1090-4906-8c17-b0a5f94762cb None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.633141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67d21f-1090-4906-8c17-b0a5f94762cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.651200 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-0c67d21f-1090-4906-8c17-b0a5f94762cb None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:32.653102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-0c67d21f-1090-4906-8c17-b0a5f94762cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:32.710564 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a116e-c533-4967-9973-f1ba70149f1b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:32.732907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:32.735951 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 368/702] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:32 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 14:16:32.753917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68ff96-163e-4f2a-aa94-f49e51dd5594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:32.754584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68ff96-163e-4f2a-aa94-f49e51dd5594 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.754895 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68ff96-163e-4f2a-aa94-f49e51dd5594 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.755423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68ff96-163e-4f2a-aa94-f49e51dd5594 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.756128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68ff96-163e-4f2a-aa94-f49e51dd5594 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:32.756434 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68ff96-163e-4f2a-aa94-f49e51dd5594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:32.758223 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68ff96-163e-4f2a-aa94-f49e51dd5594 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:32.762479 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67d21f-1090-4906-8c17-b0a5f94762cb None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:32.764783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 335/703] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 14:16:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:32.770431 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68ff96-163e-4f2a-aa94-f49e51dd5594 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:32.903501 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67d21f-1090-4906-8c17-b0a5f94762cb None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:32.908005 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68ff96-163e-4f2a-aa94-f49e51dd5594 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:32.921922 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:32.941217 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b6ab9-d519-4325-98cd-aa67c3fbb3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:32.942025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b6ab9-d519-4325-98cd-aa67c3fbb3d0 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.942306 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b6ab9-d519-4325-98cd-aa67c3fbb3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.942776 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b6ab9-d519-4325-98cd-aa67c3fbb3d0 None admin] PATH_INFO: `/v3/services/network` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.943547 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b6ab9-d519-4325-98cd-aa67c3fbb3d0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:32.945007 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b6ab9-d519-4325-98cd-aa67c3fbb3d0 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:32.949771 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6ed3-369e-41d3-aff1-2a3206c66eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:32.950750 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6ed3-369e-41d3-aff1-2a3206c66eac None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:32.951254 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6ed3-369e-41d3-aff1-2a3206c66eac None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:32.951732 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c6ed3-369e-41d3-aff1-2a3206c66eac None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:32.952651 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6ed3-369e-41d3-aff1-2a3206c66eac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:32.953157 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6ed3-369e-41d3-aff1-2a3206c66eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:32.954930 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c6ed3-369e-41d3-aff1-2a3206c66eac None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-bf6b6ab9-d519-4325-98cd-aa67c3fbb3d0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:32.958471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:32.959507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:32.960467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 369/704] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:32 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:32.964837 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 336/705] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 14:16:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:32.965579 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b6ab9-d519-4325-98cd-aa67c3fbb3d0 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:32.972891 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6ed3-369e-41d3-aff1-2a3206c66eac None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:33.035033 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:33.085710 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c6ed3-369e-41d3-aff1-2a3206c66eac None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:33.087391 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b6ab9-d519-4325-98cd-aa67c3fbb3d0 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:33.128219 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486887a6-c90d-4d63-9544-9a37e7971d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:33.128860 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62b038-dd5d-468c-b1d1-76aa26155db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:33.129274 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486887a6-c90d-4d63-9544-9a37e7971d36 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:33.129604 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486887a6-c90d-4d63-9544-9a37e7971d36 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:33.129948 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486887a6-c90d-4d63-9544-9a37e7971d36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:33.130748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62b038-dd5d-468c-b1d1-76aa26155db5 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:33.131177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486887a6-c90d-4d63-9544-9a37e7971d36 None admin] RBAC: Adding query filter params (interface=public, service_id=d4dcb354c9984ad0b8ea69c44041775f, region_id=RegionOne) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:33.131392 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62b038-dd5d-468c-b1d1-76aa26155db5 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:33.131600 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486887a6-c90d-4d63-9544-9a37e7971d36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:33.132030 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62b038-dd5d-468c-b1d1-76aa26155db5 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:33.132920 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62b038-dd5d-468c-b1d1-76aa26155db5 None admin] RBAC: Adding query filter params (name=network) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:33.133159 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486887a6-c90d-4d63-9544-9a37e7971d36 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:33.133589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62b038-dd5d-468c-b1d1-76aa26155db5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:33.135252 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62b038-dd5d-468c-b1d1-76aa26155db5 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:33.142675 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 337/706] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 14:16:32 2022] GET /identity/v3/endpoints?service_id=d4dcb354c9984ad0b8ea69c44041775f&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:33.144848 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 370/707] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:33.145292 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486887a6-c90d-4d63-9544-9a37e7971d36 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:33.151667 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62b038-dd5d-468c-b1d1-76aa26155db5 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:33.213423 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:33.283117 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486887a6-c90d-4d63-9544-9a37e7971d36 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:33.285906 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62b038-dd5d-468c-b1d1-76aa26155db5 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:33.299339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:33.331658 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ba9fc-d79a-4804-a879-b1e8355f9299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:33.332051 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c0467-9c1c-49d8-a790-5528251e427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:33.332816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c0467-9c1c-49d8-a790-5528251e427d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:33.333077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba9fc-d79a-4804-a879-b1e8355f9299 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:33.333181 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c0467-9c1c-49d8-a790-5528251e427d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:33.333503 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c0467-9c1c-49d8-a790-5528251e427d None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:33.333841 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba9fc-d79a-4804-a879-b1e8355f9299 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:33.334291 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ba9fc-d79a-4804-a879-b1e8355f9299 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:33.334404 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c0467-9c1c-49d8-a790-5528251e427d None admin] RBAC: Adding query filter params (type=network) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:33.334742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c0467-9c1c-49d8-a790-5528251e427d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:33.335458 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ba9fc-d79a-4804-a879-b1e8355f9299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:33.336263 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c0467-9c1c-49d8-a790-5528251e427d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:33.337183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ba9fc-d79a-4804-a879-b1e8355f9299 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:33.346165 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 371/708] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:33.347956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c0467-9c1c-49d8-a790-5528251e427d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:33.349855 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 338/709] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 14:16:33 2022] GET /identity/v3/services => generated 1002 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:16:33.440424 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dbaf5-ba5b-4813-b42e-00701b5a0247 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:33.440620 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dbaf5-ba5b-4813-b42e-00701b5a0247 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:33.440894 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dbaf5-ba5b-4813-b42e-00701b5a0247 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:33.442542 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 339/710] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:33.448972 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43a751-f275-4770-8bbf-9aa575d1d7f8 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:33.448972 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43a751-f275-4770-8bbf-9aa575d1d7f8 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:33.448972 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43a751-f275-4770-8bbf-9aa575d1d7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:33.470239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-bb43a751-f275-4770-8bbf-9aa575d1d7f8 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:33.471531 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-bb43a751-f275-4770-8bbf-9aa575d1d7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:33.484255 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c0467-9c1c-49d8-a790-5528251e427d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:33.526099 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:33.531418 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb1790-3e4e-464f-8094-5a3aceff4dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:33.536262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1790-3e4e-464f-8094-5a3aceff4dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:33.536262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1790-3e4e-464f-8094-5a3aceff4dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:33.536262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1790-3e4e-464f-8094-5a3aceff4dc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:33.536262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb1790-3e4e-464f-8094-5a3aceff4dc1 None admin] RBAC: Adding query filter params (interface=public, service_id=5b276316c2ba4ccda35969877fa8ae5a, region_id=RegionOne) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:33.536262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb1790-3e4e-464f-8094-5a3aceff4dc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:33.536792 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb1790-3e4e-464f-8094-5a3aceff4dc1 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:33.549024 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 372/711] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 14:16:33 2022] GET /identity/v3/endpoints?service_id=5b276316c2ba4ccda35969877fa8ae5a&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:33.554668 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb1790-3e4e-464f-8094-5a3aceff4dc1 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:33.566691 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 340/712] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:33 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 14:16:33.593213 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43a751-f275-4770-8bbf-9aa575d1d7f8 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:33.694764 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb1790-3e4e-464f-8094-5a3aceff4dc1 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:33.720225 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43a751-f275-4770-8bbf-9aa575d1d7f8 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:33.722117 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:33.742547 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7d5a6-3987-4b20-bb90-82dd488f89c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:33.743099 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d5a6-3987-4b20-bb90-82dd488f89c6 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:33.743179 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d5a6-3987-4b20-bb90-82dd488f89c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:33.752459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7d5a6-3987-4b20-bb90-82dd488f89c6 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:33.752459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7d5a6-3987-4b20-bb90-82dd488f89c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:33.752459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7d5a6-3987-4b20-bb90-82dd488f89c6 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:33.755721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 373/713] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 14:16:33 2022] GET /identity/v3/services => generated 1002 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:16:33.760038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd5bb6-fa79-4639-8560-652f35d2f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:33.761102 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5bb6-fa79-4639-8560-652f35d2f2c5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:33.762215 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5bb6-fa79-4639-8560-652f35d2f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:33.762770 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5bb6-fa79-4639-8560-652f35d2f2c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:33.775789 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd5bb6-fa79-4639-8560-652f35d2f2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-1ebd5bb6-fa79-4639-8560-652f35d2f2c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:16:33.785209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:33.786232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:16:33.787098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:33.790034 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 341/714] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:16:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:33.796362 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7d5a6-3987-4b20-bb90-82dd488f89c6 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:33.844062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:33.922528 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7d5a6-3987-4b20-bb90-82dd488f89c6 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:33.964615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e71db-63b6-4540-bec5-d63f8982159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:33.965163 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e71db-63b6-4540-bec5-d63f8982159a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:33.965509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e71db-63b6-4540-bec5-d63f8982159a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:33.965786 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e71db-63b6-4540-bec5-d63f8982159a None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:33.966591 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e71db-63b6-4540-bec5-d63f8982159a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:33.966935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e71db-63b6-4540-bec5-d63f8982159a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:33.968325 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e71db-63b6-4540-bec5-d63f8982159a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:33.977593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 374/715] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:16:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:33.984372 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd5bb6-fa79-4639-8560-652f35d2f2c5 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:34.097861 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd5bb6-fa79-4639-8560-652f35d2f2c5 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:34.135247 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9d467-18ad-4b6c-bc08-53d36833e6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:34.136049 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9d467-18ad-4b6c-bc08-53d36833e6c6 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:34.136659 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9d467-18ad-4b6c-bc08-53d36833e6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:34.136768 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9d467-18ad-4b6c-bc08-53d36833e6c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:34.148777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9d467-18ad-4b6c-bc08-53d36833e6c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:34.150262 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9d467-18ad-4b6c-bc08-53d36833e6c6 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-dcb9d467-18ad-4b6c-bc08-53d36833e6c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:34.169483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:34.170397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:34.171335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:34.171335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:34.171335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:34.171335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:34.171335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 342/716] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:34.176628 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e71db-63b6-4540-bec5-d63f8982159a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:34.284888 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:34.287962 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e71db-63b6-4540-bec5-d63f8982159a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:34.325083 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d85cdc-c728-49e1-a673-402dc1c5e51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:34.325862 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85cdc-c728-49e1-a673-402dc1c5e51e None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:34.326145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85cdc-c728-49e1-a673-402dc1c5e51e None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:34.326419 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d85cdc-c728-49e1-a673-402dc1c5e51e None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:34.327246 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d85cdc-c728-49e1-a673-402dc1c5e51e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:34.327560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d85cdc-c728-49e1-a673-402dc1c5e51e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:34.328935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d85cdc-c728-49e1-a673-402dc1c5e51e None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:34.342599 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 375/717] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:34.348399 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9d467-18ad-4b6c-bc08-53d36833e6c6 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:34.367656 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:34.468565 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9d467-18ad-4b6c-bc08-53d36833e6c6 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:34.507812 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86ee72-23fd-45ab-80dd-8da5776ddb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:34.508877 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86ee72-23fd-45ab-80dd-8da5776ddb60 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:34.509341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86ee72-23fd-45ab-80dd-8da5776ddb60 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:34.509773 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86ee72-23fd-45ab-80dd-8da5776ddb60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:34.519420 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86ee72-23fd-45ab-80dd-8da5776ddb60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:34.521092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86ee72-23fd-45ab-80dd-8da5776ddb60 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-0e86ee72-23fd-45ab-80dd-8da5776ddb60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:34.536842 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:34.537983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:34.539149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:34.539149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:34.539149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:34.539149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:34.539149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:34.539149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:34.539149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:34.539149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:34.539149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 14:16:34.539149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:34.541287 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 343/718] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Jun 2 14:16:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:34.548170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d85cdc-c728-49e1-a673-402dc1c5e51e None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:34.664146 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d85cdc-c728-49e1-a673-402dc1c5e51e None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:34.700497 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5e012-a19e-4d99-b832-8806994081b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:34.701326 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e012-a19e-4d99-b832-8806994081b7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:34.701709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e012-a19e-4d99-b832-8806994081b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:34.702105 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e012-a19e-4d99-b832-8806994081b7 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:34.703122 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5e012-a19e-4d99-b832-8806994081b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:34.703534 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5e012-a19e-4d99-b832-8806994081b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:34.705154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5e012-a19e-4d99-b832-8806994081b7 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:34.723960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 376/719] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Jun 2 14:16:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:34.729342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86ee72-23fd-45ab-80dd-8da5776ddb60 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:34.814162 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:34.842062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86ee72-23fd-45ab-80dd-8da5776ddb60 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:34.884860 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61825e41-6965-44b6-89fd-80b05c20fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:34.887200 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825e41-6965-44b6-89fd-80b05c20fe5b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:34.887200 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825e41-6965-44b6-89fd-80b05c20fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:34.887200 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825e41-6965-44b6-89fd-80b05c20fe5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:34.942455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2e97-70d5-43a1-9bda-a223e47b0028 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:34.943024 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2e97-70d5-43a1-9bda-a223e47b0028 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:34.943024 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2e97-70d5-43a1-9bda-a223e47b0028 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:34.944489 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 377/720] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:34.951367 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d61a42-1452-410b-b8a6-47126b4d8296 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:34.952128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d61a42-1452-410b-b8a6-47126b4d8296 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:34.952564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d61a42-1452-410b-b8a6-47126b4d8296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:34.964484 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61825e41-6965-44b6-89fd-80b05c20fe5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:34.966516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61825e41-6965-44b6-89fd-80b05c20fe5b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:34.973079 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-f2d61a42-1452-410b-b8a6-47126b4d8296 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:34.974524 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-f2d61a42-1452-410b-b8a6-47126b4d8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:34.988433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:35.055086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:35.070136 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 378/721] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:35.097562 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 344/722] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:34 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 14:16:35.100741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d61a42-1452-410b-b8a6-47126b4d8296 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:35.103355 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61825e41-6965-44b6-89fd-80b05c20fe5b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:35.208031 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61825e41-6965-44b6-89fd-80b05c20fe5b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:35.231043 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d61a42-1452-410b-b8a6-47126b4d8296 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:35.249627 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ded5d-26b5-4265-902f-8b87c14a8a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:35.251074 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ded5d-26b5-4265-902f-8b87c14a8a06 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:35.251566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ded5d-26b5-4265-902f-8b87c14a8a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:35.252024 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ded5d-26b5-4265-902f-8b87c14a8a06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:35.267422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ded5d-26b5-4265-902f-8b87c14a8a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:35.269481 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ded5d-26b5-4265-902f-8b87c14a8a06 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:35.270372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd08bf-9d7e-418f-a689-6d64b6e979c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:35.271294 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd08bf-9d7e-418f-a689-6d64b6e979c9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:35.271654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd08bf-9d7e-418f-a689-6d64b6e979c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:35.272029 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd08bf-9d7e-418f-a689-6d64b6e979c9 None admin] PATH_INFO: `/v3/services/image` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:35.272897 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd08bf-9d7e-418f-a689-6d64b6e979c9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:35.274687 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd08bf-9d7e-418f-a689-6d64b6e979c9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-9fbd08bf-9d7e-418f-a689-6d64b6e979c9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:35.288861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:35.289847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 14:16:35.290709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-8a0ded5d-26b5-4265-902f-8b87c14a8a06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:35.293754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:35.294613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:35.295524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:35.295524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:35.295524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:35.295524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:35.295744 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 379/723] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Jun 2 14:16:35 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:35.296650 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd08bf-9d7e-418f-a689-6d64b6e979c9 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:35.297796 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 345/724] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:35.304011 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ded5d-26b5-4265-902f-8b87c14a8a06 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:35.315681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:35.334074 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:35.418583 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ded5d-26b5-4265-902f-8b87c14a8a06 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:35.442255 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd08bf-9d7e-418f-a689-6d64b6e979c9 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:35.457031 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c17e3-53fe-4d46-a5fd-236f1a9aa30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:35.458414 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c17e3-53fe-4d46-a5fd-236f1a9aa30a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:35.458969 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c17e3-53fe-4d46-a5fd-236f1a9aa30a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:35.459973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c17e3-53fe-4d46-a5fd-236f1a9aa30a None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:35.461265 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c17e3-53fe-4d46-a5fd-236f1a9aa30a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:35.461799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c17e3-53fe-4d46-a5fd-236f1a9aa30a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:35.464270 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c17e3-53fe-4d46-a5fd-236f1a9aa30a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:35.482930 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9a665-6b77-4de6-b4a5-a830a03efe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:35.483483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 346/725] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:35.483592 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9a665-6b77-4de6-b4a5-a830a03efe57 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:35.483895 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9a665-6b77-4de6-b4a5-a830a03efe57 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:35.484159 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9a665-6b77-4de6-b4a5-a830a03efe57 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:35.484883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9a665-6b77-4de6-b4a5-a830a03efe57 None admin] RBAC: Adding query filter params (name=image) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:35.485192 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9a665-6b77-4de6-b4a5-a830a03efe57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:35.486621 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9a665-6b77-4de6-b4a5-a830a03efe57 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:35.492645 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c17e3-53fe-4d46-a5fd-236f1a9aa30a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:35.502390 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 380/726] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:35.503669 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9a665-6b77-4de6-b4a5-a830a03efe57 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:35.593066 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:35.608874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c17e3-53fe-4d46-a5fd-236f1a9aa30a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:35.618269 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:35.646319 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf5921-aceb-4927-b655-0ef7c1287830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:35.647171 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf5921-aceb-4927-b655-0ef7c1287830 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:35.647448 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf5921-aceb-4927-b655-0ef7c1287830 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:35.647718 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf5921-aceb-4927-b655-0ef7c1287830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:35.653079 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9a665-6b77-4de6-b4a5-a830a03efe57 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:35.657276 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf5921-aceb-4927-b655-0ef7c1287830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:35.658989 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf5921-aceb-4927-b655-0ef7c1287830 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-fdbf5921-aceb-4927-b655-0ef7c1287830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:35.678459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:35.679674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:35.680820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:35.680820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:35.680820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:35.680820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:35.680820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:35.680820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:35.680820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:35.680820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:35.683948 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 347/727] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:35.689146 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf5921-aceb-4927-b655-0ef7c1287830 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:35.695819 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c86054-12f1-4ee0-b615-f059c1187cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:35.696500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c86054-12f1-4ee0-b615-f059c1187cb4 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:35.696786 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c86054-12f1-4ee0-b615-f059c1187cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:35.697065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c86054-12f1-4ee0-b615-f059c1187cb4 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:35.697781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c86054-12f1-4ee0-b615-f059c1187cb4 None admin] RBAC: Adding query filter params (type=image) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:35.698092 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c86054-12f1-4ee0-b615-f059c1187cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:35.700290 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c86054-12f1-4ee0-b615-f059c1187cb4 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:35.712625 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 381/728] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:35.713523 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c86054-12f1-4ee0-b615-f059c1187cb4 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:35.815584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf5921-aceb-4927-b655-0ef7c1287830 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:35.844998 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c86054-12f1-4ee0-b615-f059c1187cb4 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:35.854557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8384ba-3166-422e-ad38-b9d3701a62d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:35.855888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8384ba-3166-422e-ad38-b9d3701a62d0 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:35.856138 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8384ba-3166-422e-ad38-b9d3701a62d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:35.856883 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8384ba-3166-422e-ad38-b9d3701a62d0 None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:35.857685 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8384ba-3166-422e-ad38-b9d3701a62d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:35.857999 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8384ba-3166-422e-ad38-b9d3701a62d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:35.859476 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8384ba-3166-422e-ad38-b9d3701a62d0 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:35.878260 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 348/729] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:35.878260 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a220-4eaf-4736-b0f5-7428171a939b None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:35.878260 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a220-4eaf-4736-b0f5-7428171a939b None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:35.878260 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a220-4eaf-4736-b0f5-7428171a939b None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:35.878260 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 349/730] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:35.885012 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289a220-4eaf-4736-b0f5-7428171a939b None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:35.896484 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:35.898592 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c97164-5fbb-47e7-9e30-c2df620ac057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:35.899878 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c97164-5fbb-47e7-9e30-c2df620ac057 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:35.900172 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c97164-5fbb-47e7-9e30-c2df620ac057 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:35.900529 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c97164-5fbb-47e7-9e30-c2df620ac057 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:35.901317 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c97164-5fbb-47e7-9e30-c2df620ac057 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:35.903495 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c97164-5fbb-47e7-9e30-c2df620ac057 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:35.912688 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:35.994292 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289a220-4eaf-4736-b0f5-7428171a939b None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:36.006896 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 382/731] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 14:16:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:36.008585 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaab3da-6747-41e4-bae3-9f92dfe02405 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.008948 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaab3da-6747-41e4-bae3-9f92dfe02405 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.009236 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaab3da-6747-41e4-bae3-9f92dfe02405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.037849 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-4aaab3da-6747-41e4-bae3-9f92dfe02405 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:36.040320 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-4aaab3da-6747-41e4-bae3-9f92dfe02405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:36.055654 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22f6f2-0796-454e-a501-a096c3f8a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:36.056540 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22f6f2-0796-454e-a501-a096c3f8a27d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.056880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22f6f2-0796-454e-a501-a096c3f8a27d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.057163 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22f6f2-0796-454e-a501-a096c3f8a27d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.058010 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22f6f2-0796-454e-a501-a096c3f8a27d None admin] RBAC: Adding query filter params (role.id=61482861f00e45048fc1d45570c4c99b, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=d9fa78e7e5be4bdcbd5c79a24895299d) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:36.058593 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22f6f2-0796-454e-a501-a096c3f8a27d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:36.060709 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22f6f2-0796-454e-a501-a096c3f8a27d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:36.074684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 350/732] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:16:35 2022] GET /identity/v3/role_assignments?user.id=d9fa78e7e5be4bdcbd5c79a24895299d&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=61482861f00e45048fc1d45570c4c99b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:36.144551 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 383/733] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:36 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:36.169567 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22f6f2-0796-454e-a501-a096c3f8a27d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:36.250101 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:36.266574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9b94-87b7-4084-baf1-e16399ac7713 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.266885 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9b94-87b7-4084-baf1-e16399ac7713 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.268558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9b94-87b7-4084-baf1-e16399ac7713 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.268790 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 384/734] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:36.275865 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9112-91b4-4794-9d52-83d341c8c099 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.276169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9112-91b4-4794-9d52-83d341c8c099 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.276419 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9112-91b4-4794-9d52-83d341c8c099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.297721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-955b9112-91b4-4794-9d52-83d341c8c099 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:36.298953 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-955b9112-91b4-4794-9d52-83d341c8c099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:36.301998 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22f6f2-0796-454e-a501-a096c3f8a27d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:36.348504 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546fea4-ab94-4111-abf2-91f9e7ddedea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:36.349332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546fea4-ab94-4111-abf2-91f9e7ddedea None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.349726 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546fea4-ab94-4111-abf2-91f9e7ddedea None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.350007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546fea4-ab94-4111-abf2-91f9e7ddedea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.350699 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546fea4-ab94-4111-abf2-91f9e7ddedea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:36.352268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546fea4-ab94-4111-abf2-91f9e7ddedea None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-2546fea4-ab94-4111-abf2-91f9e7ddedea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:36.367731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:36.368708 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:36.369544 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 351/735] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Jun 2 14:16:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:36.377270 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546fea4-ab94-4111-abf2-91f9e7ddedea None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:36.397436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 385/736] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:36 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 14:16:36.422746 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b9112-91b4-4794-9d52-83d341c8c099 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:36.482967 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:36.489885 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546fea4-ab94-4111-abf2-91f9e7ddedea None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:36.523052 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:36.528740 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a537aca-dc25-4832-8054-391ee7b4106f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:36.529553 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a537aca-dc25-4832-8054-391ee7b4106f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.529944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a537aca-dc25-4832-8054-391ee7b4106f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.530325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a537aca-dc25-4832-8054-391ee7b4106f None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.531182 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a537aca-dc25-4832-8054-391ee7b4106f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:36.532023 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a537aca-dc25-4832-8054-391ee7b4106f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:36.532639 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b9112-91b4-4794-9d52-83d341c8c099 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:36.533749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a537aca-dc25-4832-8054-391ee7b4106f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:36.544794 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 352/737] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 14:16:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:36.547963 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a537aca-dc25-4832-8054-391ee7b4106f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:36.575716 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f074f1-1684-467b-9216-e1d4e8736d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:36.576779 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f074f1-1684-467b-9216-e1d4e8736d7b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.577240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f074f1-1684-467b-9216-e1d4e8736d7b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.577654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f074f1-1684-467b-9216-e1d4e8736d7b None admin] PATH_INFO: `/v3/services/network` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.578461 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f074f1-1684-467b-9216-e1d4e8736d7b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:36.580044 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f074f1-1684-467b-9216-e1d4e8736d7b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-89f074f1-1684-467b-9216-e1d4e8736d7b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:36.592619 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:36.593839 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 14:16:36.594924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:36.602211 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 386/738] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:36 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:36.604001 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f074f1-1684-467b-9216-e1d4e8736d7b None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:36.684563 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a537aca-dc25-4832-8054-391ee7b4106f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:36.726360 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f074f1-1684-467b-9216-e1d4e8736d7b None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:36.736671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003e72f-00aa-45c0-8868-988461269901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:36.737903 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003e72f-00aa-45c0-8868-988461269901 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.738341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003e72f-00aa-45c0-8868-988461269901 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.738890 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003e72f-00aa-45c0-8868-988461269901 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.740198 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003e72f-00aa-45c0-8868-988461269901 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:36.740663 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003e72f-00aa-45c0-8868-988461269901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:36.742611 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003e72f-00aa-45c0-8868-988461269901 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:36.750193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 353/739] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Jun 2 14:16:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:36.751829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:36.756292 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003e72f-00aa-45c0-8868-988461269901 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:36.770426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98d4b2-41f4-457d-a01f-562dbe37373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:36.771286 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98d4b2-41f4-457d-a01f-562dbe37373a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.771674 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98d4b2-41f4-457d-a01f-562dbe37373a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.772057 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98d4b2-41f4-457d-a01f-562dbe37373a None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.773379 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98d4b2-41f4-457d-a01f-562dbe37373a None admin] RBAC: Adding query filter params (name=network) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:36.773794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98d4b2-41f4-457d-a01f-562dbe37373a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:36.775905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98d4b2-41f4-457d-a01f-562dbe37373a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:36.786731 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 387/740] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:36.790047 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98d4b2-41f4-457d-a01f-562dbe37373a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:36.839749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:36.898986 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003e72f-00aa-45c0-8868-988461269901 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:36.938664 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98d4b2-41f4-457d-a01f-562dbe37373a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:36.950153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed546eb-3759-4c51-8f9f-9f1b0c412097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:36.951769 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed546eb-3759-4c51-8f9f-9f1b0c412097 None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.952130 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed546eb-3759-4c51-8f9f-9f1b0c412097 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.952484 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed546eb-3759-4c51-8f9f-9f1b0c412097 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.953341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed546eb-3759-4c51-8f9f-9f1b0c412097 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:36.955562 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed546eb-3759-4c51-8f9f-9f1b0c412097 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:36.981336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b673a6-d6e6-4b90-a260-37af0b247473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:36.982099 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b673a6-d6e6-4b90-a260-37af0b247473 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:36.982460 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b673a6-d6e6-4b90-a260-37af0b247473 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:36.982871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b673a6-d6e6-4b90-a260-37af0b247473 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:36.983653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b673a6-d6e6-4b90-a260-37af0b247473 None admin] RBAC: Adding query filter params (type=network) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:36.984036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b673a6-d6e6-4b90-a260-37af0b247473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:36.985555 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b673a6-d6e6-4b90-a260-37af0b247473 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:36.991017 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 388/741] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:36.997385 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b673a6-d6e6-4b90-a260-37af0b247473 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:37.053196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:37.058431 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 354/742] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 14:16:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:37.132867 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b673a6-d6e6-4b90-a260-37af0b247473 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:37.183960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f5d8c-8391-4a4d-b0ef-5ae57bb68d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:37.185223 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f5d8c-8391-4a4d-b0ef-5ae57bb68d80 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:37.185715 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f5d8c-8391-4a4d-b0ef-5ae57bb68d80 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:37.186194 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f5d8c-8391-4a4d-b0ef-5ae57bb68d80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:37.187225 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f5d8c-8391-4a4d-b0ef-5ae57bb68d80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:37.188943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f5d8c-8391-4a4d-b0ef-5ae57bb68d80 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:37.297270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 389/743] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 14:16:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:38.459303 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201efcb-ce70-4919-b79c-1a4911dde512 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:38.459858 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201efcb-ce70-4919-b79c-1a4911dde512 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:38.459858 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201efcb-ce70-4919-b79c-1a4911dde512 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:38.461343 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 355/744] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:38.466378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431a740-a57c-45de-8cb0-73b482490fc4 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:38.466793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431a740-a57c-45de-8cb0-73b482490fc4 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:38.466985 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431a740-a57c-45de-8cb0-73b482490fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:38.484187 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-d431a740-a57c-45de-8cb0-73b482490fc4 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:38.485387 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-d431a740-a57c-45de-8cb0-73b482490fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:38.566682 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 390/745] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:38 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:38.566874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e0d6-538c-4339-bba0-069dbae06446 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:38.566874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e0d6-538c-4339-bba0-069dbae06446 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:38.566874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e0d6-538c-4339-bba0-069dbae06446 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:38.570711 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 356/746] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:38.584547 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4274b43-f63e-42b6-80c6-f5463bd43d46 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:38.584841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4274b43-f63e-42b6-80c6-f5463bd43d46 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:38.585132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4274b43-f63e-42b6-80c6-f5463bd43d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:38.595591 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601e0d6-538c-4339-bba0-069dbae06446 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:38.604485 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-d4274b43-f63e-42b6-80c6-f5463bd43d46 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:38.607182 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-d4274b43-f63e-42b6-80c6-f5463bd43d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:38.626315 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:38.682198 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 391/747] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:38 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:38.704982 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601e0d6-538c-4339-bba0-069dbae06446 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:38.706046 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4274b43-f63e-42b6-80c6-f5463bd43d46 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:38.720897 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:38.744595 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa898b-6b76-4f5b-a1ea-af3149a4174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:38.745787 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa898b-6b76-4f5b-a1ea-af3149a4174d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:38.746223 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa898b-6b76-4f5b-a1ea-af3149a4174d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:38.746614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa898b-6b76-4f5b-a1ea-af3149a4174d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:38.818794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4274b43-f63e-42b6-80c6-f5463bd43d46 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:38.823717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa898b-6b76-4f5b-a1ea-af3149a4174d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:38.825248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa898b-6b76-4f5b-a1ea-af3149a4174d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:38.858164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b322bf-2804-4284-8b9c-de03ede5b893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:38.859099 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b322bf-2804-4284-8b9c-de03ede5b893 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:38.859388 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b322bf-2804-4284-8b9c-de03ede5b893 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:38.859733 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b322bf-2804-4284-8b9c-de03ede5b893 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:38.860404 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b322bf-2804-4284-8b9c-de03ede5b893 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:38.861902 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b322bf-2804-4284-8b9c-de03ede5b893 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-43b322bf-2804-4284-8b9c-de03ede5b893 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:38.874861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:38.875794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:38.876623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 392/748] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Jun 2 14:16:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:38.883582 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b322bf-2804-4284-8b9c-de03ede5b893 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:38.906295 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:38.943743 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 357/749] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:16:38 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 14:16:38.949363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa898b-6b76-4f5b-a1ea-af3149a4174d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:38.965370 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:38.997152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b322bf-2804-4284-8b9c-de03ede5b893 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:39.034698 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3972c6e-7953-425a-978c-063ee4244c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:39.035367 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3972c6e-7953-425a-978c-063ee4244c9a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:39.035653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3972c6e-7953-425a-978c-063ee4244c9a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:39.035931 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3972c6e-7953-425a-978c-063ee4244c9a None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:39.036649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3972c6e-7953-425a-978c-063ee4244c9a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:39.036960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3972c6e-7953-425a-978c-063ee4244c9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:39.038340 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3972c6e-7953-425a-978c-063ee4244c9a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:39.048016 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 393/750] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 14:16:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:39.049287 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3972c6e-7953-425a-978c-063ee4244c9a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:39.056029 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa898b-6b76-4f5b-a1ea-af3149a4174d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:39.092785 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92382516-ffca-4a1c-b683-e8e14de45b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:39.093599 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92382516-ffca-4a1c-b683-e8e14de45b43 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:39.093882 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92382516-ffca-4a1c-b683-e8e14de45b43 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:39.094158 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92382516-ffca-4a1c-b683-e8e14de45b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:39.106500 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92382516-ffca-4a1c-b683-e8e14de45b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:39.108011 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92382516-ffca-4a1c-b683-e8e14de45b43 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-92382516-ffca-4a1c-b683-e8e14de45b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:16:39.126156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:39.127325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:39.128205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:16:39.128205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:16:39.128205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:16:39.128205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:39.128205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 358/751] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:39.134119 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92382516-ffca-4a1c-b683-e8e14de45b43 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:39.149498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:39.171774 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3972c6e-7953-425a-978c-063ee4244c9a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:39.209086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:39.209554 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32e294-9ec2-4a90-940e-52914c097909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:39.210581 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32e294-9ec2-4a90-940e-52914c097909 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:39.211235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32e294-9ec2-4a90-940e-52914c097909 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:39.211235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32e294-9ec2-4a90-940e-52914c097909 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:39.211869 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32e294-9ec2-4a90-940e-52914c097909 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:39.212180 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32e294-9ec2-4a90-940e-52914c097909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:39.213638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32e294-9ec2-4a90-940e-52914c097909 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:39.218835 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 394/752] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 14:16:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:39.248184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92382516-ffca-4a1c-b683-e8e14de45b43 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:39.287713 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2565c4-8cfa-46a8-b864-6e6baae6ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:39.288408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2565c4-8cfa-46a8-b864-6e6baae6ea4b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:39.288690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2565c4-8cfa-46a8-b864-6e6baae6ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:39.288968 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2565c4-8cfa-46a8-b864-6e6baae6ea4b None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:39.289723 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2565c4-8cfa-46a8-b864-6e6baae6ea4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:39.290033 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2565c4-8cfa-46a8-b864-6e6baae6ea4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:39.291509 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2565c4-8cfa-46a8-b864-6e6baae6ea4b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:39.310705 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 359/753] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:39.500794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880da37-fb68-4774-aa14-4c88dcc54e69 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:39.501285 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880da37-fb68-4774-aa14-4c88dcc54e69 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:39.501285 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880da37-fb68-4774-aa14-4c88dcc54e69 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:39.502627 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 395/754] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:39.508490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f55d1-024f-4a78-9e7b-b75b868f6305 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:39.508927 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f55d1-024f-4a78-9e7b-b75b868f6305 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:39.509122 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f55d1-024f-4a78-9e7b-b75b868f6305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:39.527918 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-cc3f55d1-024f-4a78-9e7b-b75b868f6305 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:39.529108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-cc3f55d1-024f-4a78-9e7b-b75b868f6305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:39.601122 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 360/755] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:39 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:39.625220 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880da37-fb68-4774-aa14-4c88dcc54e69 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:39.730956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880da37-fb68-4774-aa14-4c88dcc54e69 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:39.766054 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142018-dbc5-419e-b0a6-31be8f5ffa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:39.766889 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142018-dbc5-419e-b0a6-31be8f5ffa95 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:39.767193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142018-dbc5-419e-b0a6-31be8f5ffa95 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:39.767469 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142018-dbc5-419e-b0a6-31be8f5ffa95 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:39.768123 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4142018-dbc5-419e-b0a6-31be8f5ffa95 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:39.769482 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4142018-dbc5-419e-b0a6-31be8f5ffa95 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-e4142018-dbc5-419e-b0a6-31be8f5ffa95 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:39.782036 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:39.783233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:39.784224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 396/756] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:16:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:39.789320 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f55d1-024f-4a78-9e7b-b75b868f6305 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:39.845409 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:39.887825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f55d1-024f-4a78-9e7b-b75b868f6305 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:39.923156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dddc4-0689-44bb-986a-6f8783408065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:39.923822 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dddc4-0689-44bb-986a-6f8783408065 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:39.924107 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dddc4-0689-44bb-986a-6f8783408065 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:39.924390 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dddc4-0689-44bb-986a-6f8783408065 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:39.925095 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dddc4-0689-44bb-986a-6f8783408065 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:39.925404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dddc4-0689-44bb-986a-6f8783408065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:39.926809 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dddc4-0689-44bb-986a-6f8783408065 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:39.931322 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 361/757] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:16:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:39.937470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142018-dbc5-419e-b0a6-31be8f5ffa95 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:39.951975 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:40.041054 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142018-dbc5-419e-b0a6-31be8f5ffa95 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:40.074596 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5826f-02e6-4ffa-8666-5280fefa30d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:40.075471 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5826f-02e6-4ffa-8666-5280fefa30d0 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:40.075761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5826f-02e6-4ffa-8666-5280fefa30d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:40.076041 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5826f-02e6-4ffa-8666-5280fefa30d0 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:40.076861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5826f-02e6-4ffa-8666-5280fefa30d0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:40.077178 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5826f-02e6-4ffa-8666-5280fefa30d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:40.078566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5826f-02e6-4ffa-8666-5280fefa30d0 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:40.083508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 397/758] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:16:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:41.595675 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ba2c6-bddf-4b83-8882-2cd9580f45d3 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:41.596269 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ba2c6-bddf-4b83-8882-2cd9580f45d3 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:41.596269 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ba2c6-bddf-4b83-8882-2cd9580f45d3 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:41.598243 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 362/759] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:41.606111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750f88-1124-4230-950e-b7595c70efbb None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:41.606591 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750f88-1124-4230-950e-b7595c70efbb None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:41.606731 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750f88-1124-4230-950e-b7595c70efbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:41.625177 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-fd750f88-1124-4230-950e-b7595c70efbb None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:41.626366 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-fd750f88-1124-4230-950e-b7595c70efbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:41.703941 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 398/760] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:41 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:41.727835 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ba2c6-bddf-4b83-8882-2cd9580f45d3 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:41.841338 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ba2c6-bddf-4b83-8882-2cd9580f45d3 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:41.865626 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:41.881347 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8ad01-5e42-47fb-ac53-c9a01896b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:41.881347 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ad01-5e42-47fb-ac53-c9a01896b728 None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:41.881347 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ad01-5e42-47fb-ac53-c9a01896b728 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:41.881347 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8ad01-5e42-47fb-ac53-c9a01896b728 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:41.882110 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8ad01-5e42-47fb-ac53-c9a01896b728 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:41.883522 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8ad01-5e42-47fb-ac53-c9a01896b728 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:41.965208 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 363/761] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 14:16:41 2022] POST /identity/v3/services => generated 269 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:42.436252 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c497d6-e947-4458-a48c-413c1203661c None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:42.436546 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c497d6-e947-4458-a48c-413c1203661c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:42.436825 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c497d6-e947-4458-a48c-413c1203661c None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:42.438231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 399/762] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:42.443810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d26a-5a7b-4211-9e73-755b42d106da None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:42.444102 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d26a-5a7b-4211-9e73-755b42d106da None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:42.444380 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d26a-5a7b-4211-9e73-755b42d106da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:42.461336 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-2b11d26a-5a7b-4211-9e73-755b42d106da None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:42.462519 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-2b11d26a-5a7b-4211-9e73-755b42d106da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:42.535420 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 364/763] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:42 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:42.559895 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c497d6-e947-4458-a48c-413c1203661c None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:42.563686 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:42.662040 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c497d6-e947-4458-a48c-413c1203661c None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:42.696291 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fd747-b40a-4512-b856-c8d618a0cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:42.696878 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fd747-b40a-4512-b856-c8d618a0cc73 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:42.697161 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fd747-b40a-4512-b856-c8d618a0cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:42.697437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fd747-b40a-4512-b856-c8d618a0cc73 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:42.698157 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fd747-b40a-4512-b856-c8d618a0cc73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:42.699831 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fd747-b40a-4512-b856-c8d618a0cc73 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:42.778670 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 400/764] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 14:16:42 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:44.328876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c18693-5177-46c8-96f8-fe3295242588 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:44.329389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c18693-5177-46c8-96f8-fe3295242588 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:44.329389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c18693-5177-46c8-96f8-fe3295242588 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:44.330759 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 365/765] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:44.335919 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8aed-1f52-40d0-88ff-27de4faa8b09 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:44.336342 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8aed-1f52-40d0-88ff-27de4faa8b09 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:44.336470 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8aed-1f52-40d0-88ff-27de4faa8b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:44.353467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-207d8aed-1f52-40d0-88ff-27de4faa8b09 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:44.354631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-207d8aed-1f52-40d0-88ff-27de4faa8b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:44.412953 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:44.426035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 401/766] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:44.450108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c18693-5177-46c8-96f8-fe3295242588 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:44.552671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c18693-5177-46c8-96f8-fe3295242588 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:44.560154 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:44.587620 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854014a8-9699-4948-8d7b-51451c14912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:44.588363 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854014a8-9699-4948-8d7b-51451c14912a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:44.588652 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854014a8-9699-4948-8d7b-51451c14912a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:44.588916 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854014a8-9699-4948-8d7b-51451c14912a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:44.590252 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854014a8-9699-4948-8d7b-51451c14912a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:44.591661 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854014a8-9699-4948-8d7b-51451c14912a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-854014a8-9699-4948-8d7b-51451c14912a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:44.603601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:44.604790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 14:16:44.606151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:44.610695 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 366/767] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Jun 2 14:16:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:44.610859 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8aed-1f52-40d0-88ff-27de4faa8b09 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:44.711927 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8aed-1f52-40d0-88ff-27de4faa8b09 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:44.745583 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9336-5693-4144-9c3a-10ed986a587d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:44.746413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9336-5693-4144-9c3a-10ed986a587d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:44.746731 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9336-5693-4144-9c3a-10ed986a587d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:44.747012 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9336-5693-4144-9c3a-10ed986a587d None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:44.747724 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc9336-5693-4144-9c3a-10ed986a587d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:44.748033 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc9336-5693-4144-9c3a-10ed986a587d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:44.749421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc9336-5693-4144-9c3a-10ed986a587d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:44.754105 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 402/768] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 14:16:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:44.760431 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854014a8-9699-4948-8d7b-51451c14912a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:44.867039 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854014a8-9699-4948-8d7b-51451c14912a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:44.902556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefba6b-d6e7-4f61-820f-3ce05045c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:44.903509 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefba6b-d6e7-4f61-820f-3ce05045c3ea None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:44.903798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefba6b-d6e7-4f61-820f-3ce05045c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:44.904082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefba6b-d6e7-4f61-820f-3ce05045c3ea None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:44.904799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefba6b-d6e7-4f61-820f-3ce05045c3ea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:44.905114 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefba6b-d6e7-4f61-820f-3ce05045c3ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:44.906501 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefba6b-d6e7-4f61-820f-3ce05045c3ea None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:44.911535 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 367/769] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 14:16:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:44.917350 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9336-5693-4144-9c3a-10ed986a587d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:44.982114 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:45.026402 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9336-5693-4144-9c3a-10ed986a587d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:45.059929 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bacf9-9e50-4438-aa3f-f64e0dfc8430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:45.060591 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bacf9-9e50-4438-aa3f-f64e0dfc8430 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:45.060879 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bacf9-9e50-4438-aa3f-f64e0dfc8430 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:45.061158 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bacf9-9e50-4438-aa3f-f64e0dfc8430 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:45.061953 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bacf9-9e50-4438-aa3f-f64e0dfc8430 None admin] RBAC: Adding query filter params (interface=public, service_id=31dbb5c91986443aad05550092f03247, region_id=RegionOne) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:45.062272 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bacf9-9e50-4438-aa3f-f64e0dfc8430 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:45.063686 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bacf9-9e50-4438-aa3f-f64e0dfc8430 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:45.068757 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 403/770] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 14:16:44 2022] GET /identity/v3/endpoints?service_id=31dbb5c91986443aad05550092f03247&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:45.074876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefba6b-d6e7-4f61-820f-3ce05045c3ea None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:45.110580 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:45.120755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b6f4-8b76-4651-b96e-1b55fb44c4ce None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:45.121180 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b6f4-8b76-4651-b96e-1b55fb44c4ce None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:45.121463 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b6f4-8b76-4651-b96e-1b55fb44c4ce None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:45.122859 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 404/771] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:45.127935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbd3d9-46d3-47f2-b9f9-1a4f2afc52e4 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:45.128219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbd3d9-46d3-47f2-b9f9-1a4f2afc52e4 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:45.128496 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbd3d9-46d3-47f2-b9f9-1a4f2afc52e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:45.145835 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-90dbd3d9-46d3-47f2-b9f9-1a4f2afc52e4 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:45.152338 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-90dbd3d9-46d3-47f2-b9f9-1a4f2afc52e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:45.181041 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefba6b-d6e7-4f61-820f-3ce05045c3ea None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:45.219524 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 405/772] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:45 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 14:16:45.221780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cb924-fc26-415f-8381-cb954403691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:45.222446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cb924-fc26-415f-8381-cb954403691f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:45.222774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cb924-fc26-415f-8381-cb954403691f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:45.223050 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cb924-fc26-415f-8381-cb954403691f None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:45.223725 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106cb924-fc26-415f-8381-cb954403691f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:45.225105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106cb924-fc26-415f-8381-cb954403691f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:45.231146 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 368/773] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 14:16:45 2022] GET /identity/v3/services => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:16:45.245723 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbd3d9-46d3-47f2-b9f9-1a4f2afc52e4 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:45.318218 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:45.373460 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbd3d9-46d3-47f2-b9f9-1a4f2afc52e4 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:45.410141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a778750-5557-487b-94ce-5a3ee2deb6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:45.410988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778750-5557-487b-94ce-5a3ee2deb6ac None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:45.411276 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778750-5557-487b-94ce-5a3ee2deb6ac None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:45.411557 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778750-5557-487b-94ce-5a3ee2deb6ac None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:45.412223 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a778750-5557-487b-94ce-5a3ee2deb6ac None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:45.413635 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a778750-5557-487b-94ce-5a3ee2deb6ac None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-7a778750-5557-487b-94ce-5a3ee2deb6ac None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:45.426784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:45.427995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:45.434883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 406/774] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:16:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:45.435804 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cb924-fc26-415f-8381-cb954403691f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:45.535097 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:45.538586 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cb924-fc26-415f-8381-cb954403691f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:45.571981 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de8631-c918-4960-b442-08e88ec2542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:45.572650 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de8631-c918-4960-b442-08e88ec2542c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:45.572937 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de8631-c918-4960-b442-08e88ec2542c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:45.573217 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de8631-c918-4960-b442-08e88ec2542c None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:45.574775 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de8631-c918-4960-b442-08e88ec2542c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:45.575090 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de8631-c918-4960-b442-08e88ec2542c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:45.576469 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de8631-c918-4960-b442-08e88ec2542c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:45.581129 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 369/775] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:16:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:16:45.586775 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a778750-5557-487b-94ce-5a3ee2deb6ac None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:45.685475 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a778750-5557-487b-94ce-5a3ee2deb6ac None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:45.697679 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:45.718750 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d20dd4-a157-4980-b118-8b4731251de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:45.719415 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d20dd4-a157-4980-b118-8b4731251de1 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:45.719702 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d20dd4-a157-4980-b118-8b4731251de1 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:45.719980 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d20dd4-a157-4980-b118-8b4731251de1 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:45.720690 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d20dd4-a157-4980-b118-8b4731251de1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:45.720998 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d20dd4-a157-4980-b118-8b4731251de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:45.722377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d20dd4-a157-4980-b118-8b4731251de1 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:45.727110 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 407/776] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:16:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:45.733571 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de8631-c918-4960-b442-08e88ec2542c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:45.837622 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de8631-c918-4960-b442-08e88ec2542c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:45.872526 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1874b9-d066-403f-bd23-3ce882169c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:45.873184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1874b9-d066-403f-bd23-3ce882169c0c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:45.873468 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1874b9-d066-403f-bd23-3ce882169c0c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:45.873744 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1874b9-d066-403f-bd23-3ce882169c0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:45.874530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1874b9-d066-403f-bd23-3ce882169c0c None admin] RBAC: Adding query filter params (interface=public, service_id=07ec990590fb4383a0fb96f10261f167, region_id=RegionOne) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:45.874872 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1874b9-d066-403f-bd23-3ce882169c0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:45.876239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1874b9-d066-403f-bd23-3ce882169c0c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:45.882249 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 370/777] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 14:16:45 2022] GET /identity/v3/endpoints?service_id=07ec990590fb4383a0fb96f10261f167&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:45.887412 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d20dd4-a157-4980-b118-8b4731251de1 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:45.987599 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d20dd4-a157-4980-b118-8b4731251de1 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:46.021196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a268d19-d8d3-4dad-ac46-0881077e4779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:46.021861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268d19-d8d3-4dad-ac46-0881077e4779 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:46.022155 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268d19-d8d3-4dad-ac46-0881077e4779 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:46.022437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268d19-d8d3-4dad-ac46-0881077e4779 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:46.023160 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a268d19-d8d3-4dad-ac46-0881077e4779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:46.024548 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a268d19-d8d3-4dad-ac46-0881077e4779 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:46.030793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 408/778] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 14:16:45 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:16:47.580937 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e79bd-1789-4c3d-b67c-6c45280add95 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:47.581491 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e79bd-1789-4c3d-b67c-6c45280add95 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:47.581581 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e79bd-1789-4c3d-b67c-6c45280add95 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:47.582993 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 371/779] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:47.588274 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659f3e3-da1a-4ff4-93af-3e790c5300bd None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:47.588691 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659f3e3-da1a-4ff4-93af-3e790c5300bd None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:47.588832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659f3e3-da1a-4ff4-93af-3e790c5300bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:47.606174 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-1659f3e3-da1a-4ff4-93af-3e790c5300bd None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:47.607377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-1659f3e3-da1a-4ff4-93af-3e790c5300bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:47.641599 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:47.672324 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 409/780] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:47 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:47.696538 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e79bd-1789-4c3d-b67c-6c45280add95 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:47.725582 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:47.801909 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e79bd-1789-4c3d-b67c-6c45280add95 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:47.834538 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ae421-5fe1-4a4c-aceb-e6261a5b995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:47.835235 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ae421-5fe1-4a4c-aceb-e6261a5b995d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:47.835522 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ae421-5fe1-4a4c-aceb-e6261a5b995d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:47.835798 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ae421-5fe1-4a4c-aceb-e6261a5b995d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:47.836448 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ae421-5fe1-4a4c-aceb-e6261a5b995d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:47.837826 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ae421-5fe1-4a4c-aceb-e6261a5b995d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-3e1ae421-5fe1-4a4c-aceb-e6261a5b995d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:47.850465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:47.851614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:47.852464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 372/781] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Jun 2 14:16:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:47.858433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659f3e3-da1a-4ff4-93af-3e790c5300bd None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:47.961087 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659f3e3-da1a-4ff4-93af-3e790c5300bd None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:47.994973 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95531aa3-6851-4b1e-890e-c9cad2da0b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:47.995865 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531aa3-6851-4b1e-890e-c9cad2da0b4b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:47.996227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531aa3-6851-4b1e-890e-c9cad2da0b4b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:47.996504 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531aa3-6851-4b1e-890e-c9cad2da0b4b None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:47.997215 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95531aa3-6851-4b1e-890e-c9cad2da0b4b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:47.997526 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95531aa3-6851-4b1e-890e-c9cad2da0b4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:47.998932 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95531aa3-6851-4b1e-890e-c9cad2da0b4b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:48.003720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 410/782] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 14:16:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:48.009880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ae421-5fe1-4a4c-aceb-e6261a5b995d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:48.104563 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:48.114195 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ae421-5fe1-4a4c-aceb-e6261a5b995d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:48.148271 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9516f2-23d6-43b6-afc5-bf8e5f9686f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:48.148944 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9516f2-23d6-43b6-afc5-bf8e5f9686f5 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:48.149223 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9516f2-23d6-43b6-afc5-bf8e5f9686f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:48.149505 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9516f2-23d6-43b6-afc5-bf8e5f9686f5 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:48.150215 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9516f2-23d6-43b6-afc5-bf8e5f9686f5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:48.150524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9516f2-23d6-43b6-afc5-bf8e5f9686f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:48.152636 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9516f2-23d6-43b6-afc5-bf8e5f9686f5 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:48.157522 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 373/783] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Jun 2 14:16:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:48.163178 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95531aa3-6851-4b1e-890e-c9cad2da0b4b None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:48.199489 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:48.266154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95531aa3-6851-4b1e-890e-c9cad2da0b4b None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:48.300624 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e12a-d14c-4721-a858-b23249684013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:48.301282 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e12a-d14c-4721-a858-b23249684013 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:48.301571 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e12a-d14c-4721-a858-b23249684013 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:48.301852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e12a-d14c-4721-a858-b23249684013 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:48.302600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9e12a-d14c-4721-a858-b23249684013 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:48.304023 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9e12a-d14c-4721-a858-b23249684013 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:48.363776 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af14f9-54a4-4717-a99b-633a183caf02 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:48.364003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af14f9-54a4-4717-a99b-633a183caf02 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:48.364288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af14f9-54a4-4717-a99b-633a183caf02 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:48.365666 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 374/784] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:16:48.370829 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8e5e-6b07-4d7c-aa08-80601fff98fb None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:48.371232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8e5e-6b07-4d7c-aa08-80601fff98fb None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:48.371731 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8e5e-6b07-4d7c-aa08-80601fff98fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:48.389538 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-2dcd8e5e-6b07-4d7c-aa08-80601fff98fb None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:48.390786 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-2dcd8e5e-6b07-4d7c-aa08-80601fff98fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:48.401857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 411/785] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 14:16:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:48.468962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 375/786] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:48 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 14:16:48.493403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e12a-d14c-4721-a858-b23249684013 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:48.594479 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:48.604460 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e12a-d14c-4721-a858-b23249684013 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:48.639261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b221cda-3081-4207-b738-82a798099a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:48.640003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b221cda-3081-4207-b738-82a798099a1d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:48.640288 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b221cda-3081-4207-b738-82a798099a1d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:48.640564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b221cda-3081-4207-b738-82a798099a1d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:48.641224 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b221cda-3081-4207-b738-82a798099a1d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:48.642624 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b221cda-3081-4207-b738-82a798099a1d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-2b221cda-3081-4207-b738-82a798099a1d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:48.655589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:48.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:48.657720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 412/787] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:16:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:48.662879 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd8e5e-6b07-4d7c-aa08-80601fff98fb None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:48.743692 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:48.763635 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd8e5e-6b07-4d7c-aa08-80601fff98fb None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:48.798170 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9002e9-f734-4197-b225-eee90e3c055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:48.798878 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9002e9-f734-4197-b225-eee90e3c055c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:48.799165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9002e9-f734-4197-b225-eee90e3c055c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:48.799442 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9002e9-f734-4197-b225-eee90e3c055c None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:48.800153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9002e9-f734-4197-b225-eee90e3c055c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:48.800463 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9002e9-f734-4197-b225-eee90e3c055c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:48.801833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9002e9-f734-4197-b225-eee90e3c055c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:48.806599 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 376/788] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:16:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:48.812464 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b221cda-3081-4207-b738-82a798099a1d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:48.918963 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b221cda-3081-4207-b738-82a798099a1d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:48.952183 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cb0e0-0240-42a5-a249-a4313a65c594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:48.952877 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cb0e0-0240-42a5-a249-a4313a65c594 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:48.953163 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cb0e0-0240-42a5-a249-a4313a65c594 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:48.953438 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cb0e0-0240-42a5-a249-a4313a65c594 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:48.954144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cb0e0-0240-42a5-a249-a4313a65c594 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:48.954452 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cb0e0-0240-42a5-a249-a4313a65c594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:48.955877 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cb0e0-0240-42a5-a249-a4313a65c594 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:48.960798 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 413/789] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Jun 2 14:16:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:48.967185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9002e9-f734-4197-b225-eee90e3c055c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:49.064489 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9002e9-f734-4197-b225-eee90e3c055c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:49.098359 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458e03e-a1bb-428d-a3bb-f3d0b8497a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:49.099120 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458e03e-a1bb-428d-a3bb-f3d0b8497a4c None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:49.099409 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458e03e-a1bb-428d-a3bb-f3d0b8497a4c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:49.099728 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458e03e-a1bb-428d-a3bb-f3d0b8497a4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:49.100479 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458e03e-a1bb-428d-a3bb-f3d0b8497a4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:49.101848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458e03e-a1bb-428d-a3bb-f3d0b8497a4c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:49.176901 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:49.182066 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 377/790] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 14:16:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:50.740046 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1ce86-0fcf-4741-a0ec-b796f4c385dd None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:50.740604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1ce86-0fcf-4741-a0ec-b796f4c385dd None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:50.740604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1ce86-0fcf-4741-a0ec-b796f4c385dd None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:50.741967 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 414/791] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:50.747602 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134364af-9d87-4a63-86a7-6bb20a45d820 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:50.748022 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134364af-9d87-4a63-86a7-6bb20a45d820 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:50.748279 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134364af-9d87-4a63-86a7-6bb20a45d820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:50.765116 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-134364af-9d87-4a63-86a7-6bb20a45d820 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:50.766296 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-134364af-9d87-4a63-86a7-6bb20a45d820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:50.837007 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 378/792] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:50 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 14:16:50.860707 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1ce86-0fcf-4741-a0ec-b796f4c385dd None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:50.885240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:50.968190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1ce86-0fcf-4741-a0ec-b796f4c385dd None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:51.003908 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c72732-a89b-41f8-b75b-337a1830389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:51.004649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72732-a89b-41f8-b75b-337a1830389d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:51.004934 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72732-a89b-41f8-b75b-337a1830389d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:51.005469 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c72732-a89b-41f8-b75b-337a1830389d None admin] PATH_INFO: `/v3/services/compute` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:51.006126 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c72732-a89b-41f8-b75b-337a1830389d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:51.007553 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c72732-a89b-41f8-b75b-337a1830389d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-60c72732-a89b-41f8-b75b-337a1830389d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:51.019421 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:51.020615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:51.021909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 415/793] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:51.026691 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134364af-9d87-4a63-86a7-6bb20a45d820 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:51.131761 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134364af-9d87-4a63-86a7-6bb20a45d820 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:51.157278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:51.165548 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a7bab-0f1f-44b2-9dff-6dd97a030443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:51.171817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a7bab-0f1f-44b2-9dff-6dd97a030443 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:51.171817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a7bab-0f1f-44b2-9dff-6dd97a030443 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:51.171817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a7bab-0f1f-44b2-9dff-6dd97a030443 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:51.171817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a7bab-0f1f-44b2-9dff-6dd97a030443 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:51.171817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a7bab-0f1f-44b2-9dff-6dd97a030443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:51.171817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a7bab-0f1f-44b2-9dff-6dd97a030443 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:51.176098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 379/794] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:51.181996 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c72732-a89b-41f8-b75b-337a1830389d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:51.266675 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:51.286106 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c72732-a89b-41f8-b75b-337a1830389d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:51.319906 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1880f-565e-4751-b3bb-b481e837d50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:51.320568 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1880f-565e-4751-b3bb-b481e837d50b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:51.320855 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1880f-565e-4751-b3bb-b481e837d50b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:51.321133 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1880f-565e-4751-b3bb-b481e837d50b None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:51.321834 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1880f-565e-4751-b3bb-b481e837d50b None admin] RBAC: Adding query filter params (type=compute) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:51.322142 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1880f-565e-4751-b3bb-b481e837d50b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:51.324077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1880f-565e-4751-b3bb-b481e837d50b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:51.328494 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 416/795] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:51.530419 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e3194-589a-4611-86d0-d199feabb3d2 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:51.530770 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e3194-589a-4611-86d0-d199feabb3d2 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:51.531055 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e3194-589a-4611-86d0-d199feabb3d2 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:51.532427 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 380/796] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:51.537775 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216e1e7-8da4-4b18-9565-68f5b305b03c None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:51.538070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216e1e7-8da4-4b18-9565-68f5b305b03c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:51.538352 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216e1e7-8da4-4b18-9565-68f5b305b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:51.556190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-f216e1e7-8da4-4b18-9565-68f5b305b03c None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:51.557388 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-f216e1e7-8da4-4b18-9565-68f5b305b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:51.624974 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 417/797] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:51 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:51.650543 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e3194-589a-4611-86d0-d199feabb3d2 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:51.752570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e3194-589a-4611-86d0-d199feabb3d2 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:51.788036 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:51.788619 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:51.788902 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:51.789177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:51.789888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:51.791362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:51.792949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: WARNING keystone.server.flask.common [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 14:16:51.841061 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.sql.core [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 14:16:51.841061 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 14:16:51.841061 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [parameters: {'id': '90dc28aa08f041b2931b2f18e6f32785', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 14:16:51.841061 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87232) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 90dc28aa08f041b2931b2f18e6f32785.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 90dc28aa08f041b2931b2f18e6f32785. Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application conn.query(q) Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 14:16:51.857350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application result.read() Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 14:16:51.858305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application next(self.gen) Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application yield resource Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application next(self.gen) Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise self.value Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application session.commit() Jun 02 14:16:51.859541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self.session.flush() Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application compat.raise_( Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 14:16:51.860797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 14:16:51.861907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application conn.query(q) Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application result.read() Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 14:16:51.862956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [parameters: {'id': '90dc28aa08f041b2931b2f18e6f32785', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:51.864113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:51.865062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:51.866135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:51.866135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 14:16:51.866135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 14:16:51.866135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:51.866135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:51.866135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 14:16:51.866135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 14:16:51.866135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 90dc28aa08f041b2931b2f18e6f32785. Jun 02 14:16:51.866135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:51.866135 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 381/798] 10.222.0.59 () {60 vars in 1140 bytes} [Thu Jun 2 14:16:51 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:51.867008 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216e1e7-8da4-4b18-9565-68f5b305b03c None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:51.945515 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:51.969105 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216e1e7-8da4-4b18-9565-68f5b305b03c None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:52.002459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe90ba6-41f7-4399-821d-ffa7e29705ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:52.003517 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe90ba6-41f7-4399-821d-ffa7e29705ec None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:52.004019 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe90ba6-41f7-4399-821d-ffa7e29705ec None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:52.004786 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe90ba6-41f7-4399-821d-ffa7e29705ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:52.012262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe90ba6-41f7-4399-821d-ffa7e29705ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:52.013726 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe90ba6-41f7-4399-821d-ffa7e29705ec None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-5fe90ba6-41f7-4399-821d-ffa7e29705ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:16:52.027815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:52.028755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:52.029793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:16:52.029793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:16:52.029793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:16:52.029793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:16:52.029793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:16:52.029793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:16:52.029793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:16:52.029793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:52.029793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 418/799] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:52.035026 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:52.083483 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:52.137962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb29c6-1b9b-4bb0-82c9-be57dc9ee804 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:52.171561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606af247-a973-445f-8652-aeae15e1fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:52.172226 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606af247-a973-445f-8652-aeae15e1fb16 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:52.172510 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606af247-a973-445f-8652-aeae15e1fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:52.172789 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606af247-a973-445f-8652-aeae15e1fb16 None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:52.173545 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606af247-a973-445f-8652-aeae15e1fb16 None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:52.173855 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606af247-a973-445f-8652-aeae15e1fb16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:52.175538 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606af247-a973-445f-8652-aeae15e1fb16 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:52.197037 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 382/800] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:53.638924 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac747f-9db9-4e40-89fd-7c4a12ca0ee2 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:53.639492 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac747f-9db9-4e40-89fd-7c4a12ca0ee2 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:53.639492 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac747f-9db9-4e40-89fd-7c4a12ca0ee2 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:53.640860 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 419/801] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:53.646382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc9a5-91cf-4ead-b70d-4c8509d6e660 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:53.646804 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc9a5-91cf-4ead-b70d-4c8509d6e660 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:53.646979 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc9a5-91cf-4ead-b70d-4c8509d6e660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:53.664804 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-26edc9a5-91cf-4ead-b70d-4c8509d6e660 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:53.666304 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-26edc9a5-91cf-4ead-b70d-4c8509d6e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:53.731551 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 383/802] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:53.755439 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac747f-9db9-4e40-89fd-7c4a12ca0ee2 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:53.856997 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac747f-9db9-4e40-89fd-7c4a12ca0ee2 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:53.895176 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e16010-8357-45ce-aca2-0b534eba4ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:53.895777 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e16010-8357-45ce-aca2-0b534eba4ad5 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:53.896061 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e16010-8357-45ce-aca2-0b534eba4ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:53.896337 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e16010-8357-45ce-aca2-0b534eba4ad5 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:53.897074 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e16010-8357-45ce-aca2-0b534eba4ad5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:53.898463 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e16010-8357-45ce-aca2-0b534eba4ad5 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:53.901557 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:53.990580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 420/803] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 14:16:53 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:16:54.558680 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251889f-32ca-43b4-b547-7dac08e5f1dc None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:54.558962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251889f-32ca-43b4-b547-7dac08e5f1dc None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:54.559240 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251889f-32ca-43b4-b547-7dac08e5f1dc None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:54.560654 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 384/804] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:54.565991 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2915d-a1d2-4b53-a484-495c93f92ef6 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:54.566282 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2915d-a1d2-4b53-a484-495c93f92ef6 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:54.566560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2915d-a1d2-4b53-a484-495c93f92ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:54.583590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-f9c2915d-a1d2-4b53-a484-495c93f92ef6 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:54.584770 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-f9c2915d-a1d2-4b53-a484-495c93f92ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:54.656747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 421/805] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:54 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:54.683516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251889f-32ca-43b4-b547-7dac08e5f1dc None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:54.719783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:54.785799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251889f-32ca-43b4-b547-7dac08e5f1dc None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:54.820088 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701b0f5-c888-4755-ae4d-24be7c1704fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:54.820679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701b0f5-c888-4755-ae4d-24be7c1704fe None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:54.820963 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701b0f5-c888-4755-ae4d-24be7c1704fe None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:54.821235 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701b0f5-c888-4755-ae4d-24be7c1704fe None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:54.821936 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701b0f5-c888-4755-ae4d-24be7c1704fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:54.823638 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701b0f5-c888-4755-ae4d-24be7c1704fe None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:54.866159 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.sql.core [None req-4701b0f5-c888-4755-ae4d-24be7c1704fe None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 14:16:54.866159 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 14:16:54.866159 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [parameters: {'user_id': 'ba6cd88fc0594dcd9de8db0b8b7cd809', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 14:16:54.866159 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87232) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-4701b0f5-c888-4755-ae4d-24be7c1704fe None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application conn.query(q) Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application result.read() Jun 02 14:16:54.875257 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 14:16:54.876272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application next(self.gen) Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application yield resource Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application next(self.gen) Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise self.value Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application session.commit() Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 14:16:54.877584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self.session.flush() Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application compat.raise_( Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 14:16:54.878679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 14:16:54.880590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application conn.query(q) Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application result.read() Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 14:16:54.885067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ba6cd88fc0594dcd9de8db0b8b7cd809', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:54.886084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 14:16:54.887530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 14:16:54.888668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 14:16:54.888668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 14:16:54.888668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 14:16:54.888668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 14:16:54.888668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 14:16:54.888668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:54.888668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 385/806] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Jun 2 14:16:54 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:54.889145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2915d-a1d2-4b53-a484-495c93f92ef6 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:54.991824 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2915d-a1d2-4b53-a484-495c93f92ef6 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:55.014363 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:55.026217 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dc9c7-273a-49ff-a47b-85633832a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:55.027081 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc9c7-273a-49ff-a47b-85633832a379 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:55.027359 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc9c7-273a-49ff-a47b-85633832a379 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:55.027633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc9c7-273a-49ff-a47b-85633832a379 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:55.034542 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dc9c7-273a-49ff-a47b-85633832a379 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:55.036007 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dc9c7-273a-49ff-a47b-85633832a379 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-243dc9c7-273a-49ff-a47b-85633832a379 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:16:55.050656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:55.051705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:55.052653 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 422/807] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:16:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:55.058626 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701b0f5-c888-4755-ae4d-24be7c1704fe None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:55.157184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:55.160809 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701b0f5-c888-4755-ae4d-24be7c1704fe None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:55.195198 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194f9e8-42bc-46ba-b1ea-897580561f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:55.195873 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f9e8-42bc-46ba-b1ea-897580561f6b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:55.196153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f9e8-42bc-46ba-b1ea-897580561f6b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:55.196428 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f9e8-42bc-46ba-b1ea-897580561f6b None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:55.197228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194f9e8-42bc-46ba-b1ea-897580561f6b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:55.197536 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194f9e8-42bc-46ba-b1ea-897580561f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:55.199341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194f9e8-42bc-46ba-b1ea-897580561f6b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:55.238950 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 386/808] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Jun 2 14:16:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:56.329589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2b9a-a9da-4edd-b9bc-6fac83c2f76e None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:56.330092 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2b9a-a9da-4edd-b9bc-6fac83c2f76e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:56.330092 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2b9a-a9da-4edd-b9bc-6fac83c2f76e None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:56.331460 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 423/809] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:56.336647 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528eebb-2256-4587-93c6-29642320382d None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:56.337078 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528eebb-2256-4587-93c6-29642320382d None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:56.337211 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528eebb-2256-4587-93c6-29642320382d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:56.354772 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-e528eebb-2256-4587-93c6-29642320382d None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:56.356303 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-e528eebb-2256-4587-93c6-29642320382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:56.421054 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 387/810] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:56 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:56.444870 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d2b9a-a9da-4edd-b9bc-6fac83c2f76e None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:56.544563 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d2b9a-a9da-4edd-b9bc-6fac83c2f76e None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:56.577433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eab18-5b4f-4570-9756-52a2e93ea1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:56.578205 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eab18-5b4f-4570-9756-52a2e93ea1b2 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:56.578488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eab18-5b4f-4570-9756-52a2e93ea1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:56.578793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eab18-5b4f-4570-9756-52a2e93ea1b2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:56.579439 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eab18-5b4f-4570-9756-52a2e93ea1b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:56.580857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eab18-5b4f-4570-9756-52a2e93ea1b2 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-fd4eab18-5b4f-4570-9756-52a2e93ea1b2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:56.592837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:56.594003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:16:56.595097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 424/811] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:16:56.600366 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528eebb-2256-4587-93c6-29642320382d None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:56.685785 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:56.700207 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528eebb-2256-4587-93c6-29642320382d None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:56.734886 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73380420-be69-483c-a166-cda25a34ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:56.735548 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380420-be69-483c-a166-cda25a34ca68 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:56.735832 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380420-be69-483c-a166-cda25a34ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:56.736109 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73380420-be69-483c-a166-cda25a34ca68 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:56.736809 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73380420-be69-483c-a166-cda25a34ca68 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:56.737116 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73380420-be69-483c-a166-cda25a34ca68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:56.738501 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73380420-be69-483c-a166-cda25a34ca68 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:56.743276 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 388/812] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:56.749135 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eab18-5b4f-4570-9756-52a2e93ea1b2 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:56.794789 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:56.845407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eab18-5b4f-4570-9756-52a2e93ea1b2 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:56.877568 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c272a96-a64b-44c7-bd13-c1d6a5f59ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:56.878210 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c272a96-a64b-44c7-bd13-c1d6a5f59ec9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:56.878492 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c272a96-a64b-44c7-bd13-c1d6a5f59ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:56.878796 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c272a96-a64b-44c7-bd13-c1d6a5f59ec9 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:56.879499 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c272a96-a64b-44c7-bd13-c1d6a5f59ec9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:56.879806 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c272a96-a64b-44c7-bd13-c1d6a5f59ec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:56.881451 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c272a96-a64b-44c7-bd13-c1d6a5f59ec9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:56.886349 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 425/813] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:56.892341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73380420-be69-483c-a166-cda25a34ca68 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:56.994808 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73380420-be69-483c-a166-cda25a34ca68 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:57.030465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75a6fc-edec-4274-b8b9-7b6e31fc9cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:57.031142 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a6fc-edec-4274-b8b9-7b6e31fc9cf7 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:57.031433 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a6fc-edec-4274-b8b9-7b6e31fc9cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:57.031710 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a6fc-edec-4274-b8b9-7b6e31fc9cf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:57.032615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75a6fc-edec-4274-b8b9-7b6e31fc9cf7 None admin] RBAC: Adding query filter params (interface=public, service_id=04af611cc2b9442bb94bff282ce7c9a3, region_id=RegionOne) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:57.032926 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75a6fc-edec-4274-b8b9-7b6e31fc9cf7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:57.034284 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75a6fc-edec-4274-b8b9-7b6e31fc9cf7 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:57.040176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 389/814] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 14:16:56 2022] GET /identity/v3/endpoints?service_id=04af611cc2b9442bb94bff282ce7c9a3&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:57.045893 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c272a96-a64b-44c7-bd13-c1d6a5f59ec9 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:57.182131 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c272a96-a64b-44c7-bd13-c1d6a5f59ec9 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:57.191895 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:57.215677 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d59706-71ae-48de-9fd4-796ddc2ff020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:57.216330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d59706-71ae-48de-9fd4-796ddc2ff020 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:57.216613 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d59706-71ae-48de-9fd4-796ddc2ff020 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:57.216891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d59706-71ae-48de-9fd4-796ddc2ff020 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:57.217565 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d59706-71ae-48de-9fd4-796ddc2ff020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:57.219017 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d59706-71ae-48de-9fd4-796ddc2ff020 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:57.225378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 426/815] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 14:16:57 2022] GET /identity/v3/services => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:16:59.528978 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199faf50-8ecc-4faa-847e-6dc5c641736a None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:59.529492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199faf50-8ecc-4faa-847e-6dc5c641736a None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:59.529492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199faf50-8ecc-4faa-847e-6dc5c641736a None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:59.530868 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 390/816] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:16:59.536155 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ef54-f63f-4c8c-965d-edaa6848ae32 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:59.536562 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ef54-f63f-4c8c-965d-edaa6848ae32 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:59.536719 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ef54-f63f-4c8c-965d-edaa6848ae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:59.553705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-c438ef54-f63f-4c8c-965d-edaa6848ae32 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:16:59.554934 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-c438ef54-f63f-4c8c-965d-edaa6848ae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:16:59.618363 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 427/817] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:16:59 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:16:59.642942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199faf50-8ecc-4faa-847e-6dc5c641736a None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:59.658821 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:59.741816 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199faf50-8ecc-4faa-847e-6dc5c641736a None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:59.774940 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91125ff6-4cd7-4326-9bbb-216c7e2a210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:59.775724 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91125ff6-4cd7-4326-9bbb-216c7e2a210a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:59.776004 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91125ff6-4cd7-4326-9bbb-216c7e2a210a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:59.776793 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91125ff6-4cd7-4326-9bbb-216c7e2a210a None admin] PATH_INFO: `/v3/services/compute` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:59.777526 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91125ff6-4cd7-4326-9bbb-216c7e2a210a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:59.778908 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91125ff6-4cd7-4326-9bbb-216c7e2a210a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-91125ff6-4cd7-4326-9bbb-216c7e2a210a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:16:59.790451 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:16:59.791660 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:16:59.793239 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 391/818] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:16:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:16:59.798464 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438ef54-f63f-4c8c-965d-edaa6848ae32 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:16:59.895580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438ef54-f63f-4c8c-965d-edaa6848ae32 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:16:59.897850 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:16:59.930219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e409a8-06d7-4f60-88a3-292d36a8e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:16:59.930905 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e409a8-06d7-4f60-88a3-292d36a8e35b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:16:59.931187 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e409a8-06d7-4f60-88a3-292d36a8e35b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:16:59.931459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e409a8-06d7-4f60-88a3-292d36a8e35b None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:16:59.932159 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e409a8-06d7-4f60-88a3-292d36a8e35b None admin] RBAC: Adding query filter params (name=compute) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:16:59.932464 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e409a8-06d7-4f60-88a3-292d36a8e35b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:16:59.933820 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e409a8-06d7-4f60-88a3-292d36a8e35b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:16:59.938448 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 428/819] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:16:59.944155 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91125ff6-4cd7-4326-9bbb-216c7e2a210a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:17:00.020738 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:17:00.041831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91125ff6-4cd7-4326-9bbb-216c7e2a210a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:17:00.075912 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edbb71-d441-4502-bad1-fbb87421d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:17:00.076612 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edbb71-d441-4502-bad1-fbb87421d8eb None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:17:00.076898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edbb71-d441-4502-bad1-fbb87421d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:17:00.077176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edbb71-d441-4502-bad1-fbb87421d8eb None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:17:00.077881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edbb71-d441-4502-bad1-fbb87421d8eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:17:00.078191 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edbb71-d441-4502-bad1-fbb87421d8eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:17:00.079602 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edbb71-d441-4502-bad1-fbb87421d8eb None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:17:00.084403 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 392/820] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Jun 2 14:16:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:17:00.090961 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e409a8-06d7-4f60-88a3-292d36a8e35b None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:17:00.187428 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e409a8-06d7-4f60-88a3-292d36a8e35b None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:17:00.220063 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbd472-d7f2-42c0-aff3-89bc389624ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:17:00.220696 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbd472-d7f2-42c0-aff3-89bc389624ca None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:17:00.220977 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbd472-d7f2-42c0-aff3-89bc389624ca None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:17:00.221248 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbd472-d7f2-42c0-aff3-89bc389624ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:17:00.221978 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbd472-d7f2-42c0-aff3-89bc389624ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:17:00.223356 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbd472-d7f2-42c0-aff3-89bc389624ca None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:17:00.288574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 429/821] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 14:17:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:17:10.081897 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=29 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:17:10.284459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:19.342747 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b92796-8365-4cb4-b804-999d650279c6 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:19.343295 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b92796-8365-4cb4-b804-999d650279c6 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:19.343295 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b92796-8365-4cb4-b804-999d650279c6 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:19.344611 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 393/822] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:19.349818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230eb57-f8aa-4462-b634-a590bb7b1f37 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:19.350968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230eb57-f8aa-4462-b634-a590bb7b1f37 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:19.350968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230eb57-f8aa-4462-b634-a590bb7b1f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:19.368019 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-2230eb57-f8aa-4462-b634-a590bb7b1f37 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:19.369203 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-2230eb57-f8aa-4462-b634-a590bb7b1f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:19.440778 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 430/823] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:19 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:19.466805 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b92796-8365-4cb4-b804-999d650279c6 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:19.569598 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b92796-8365-4cb4-b804-999d650279c6 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:19.604362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59be014-74c9-4d49-a37d-af0cdace4eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:19.607910 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59be014-74c9-4d49-a37d-af0cdace4eb7 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:19.607910 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59be014-74c9-4d49-a37d-af0cdace4eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:19.607910 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59be014-74c9-4d49-a37d-af0cdace4eb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:19.616302 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59be014-74c9-4d49-a37d-af0cdace4eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:19.617765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59be014-74c9-4d49-a37d-af0cdace4eb7 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-c59be014-74c9-4d49-a37d-af0cdace4eb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:19.634863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:19.638245 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:19.639251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:19.639251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:19.639251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:19.639251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:19.639251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 394/824] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:19.642493 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230eb57-f8aa-4462-b634-a590bb7b1f37 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:19.743498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230eb57-f8aa-4462-b634-a590bb7b1f37 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:19.768127 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:19.777195 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc4da1-7bea-4084-8083-abe775e78a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:19.778065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc4da1-7bea-4084-8083-abe775e78a57 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:19.778351 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc4da1-7bea-4084-8083-abe775e78a57 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:19.778620 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc4da1-7bea-4084-8083-abe775e78a57 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:19.779364 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc4da1-7bea-4084-8083-abe775e78a57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:19.779669 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc4da1-7bea-4084-8083-abe775e78a57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:19.781041 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc4da1-7bea-4084-8083-abe775e78a57 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:19.792911 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 431/825] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:19.798627 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59be014-74c9-4d49-a37d-af0cdace4eb7 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:19.854080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:19.901489 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59be014-74c9-4d49-a37d-af0cdace4eb7 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:19.934746 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860cbdf-f63b-4168-b986-1821b1cfc04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:19.935409 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860cbdf-f63b-4168-b986-1821b1cfc04d None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:19.935690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860cbdf-f63b-4168-b986-1821b1cfc04d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:19.935962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860cbdf-f63b-4168-b986-1821b1cfc04d None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:19.936672 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860cbdf-f63b-4168-b986-1821b1cfc04d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:19.938185 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860cbdf-f63b-4168-b986-1821b1cfc04d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:20.092495 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 395/826] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Jun 2 14:18:19 2022] POST /identity/v3/users => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:18:22.511444 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc5a50-d4bf-4636-9261-582b0d613ef7 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:22.512010 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc5a50-d4bf-4636-9261-582b0d613ef7 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:22.512113 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc5a50-d4bf-4636-9261-582b0d613ef7 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:22.513510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 432/827] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:22.518903 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad3d6d-6ab3-4b2d-9d99-7f3c6ca97f09 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:22.519418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad3d6d-6ab3-4b2d-9d99-7f3c6ca97f09 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:22.519527 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad3d6d-6ab3-4b2d-9d99-7f3c6ca97f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:22.536446 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-b6ad3d6d-6ab3-4b2d-9d99-7f3c6ca97f09 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:22.538312 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-b6ad3d6d-6ab3-4b2d-9d99-7f3c6ca97f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:22.604663 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 396/828] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:22 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:22.632539 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc5a50-d4bf-4636-9261-582b0d613ef7 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:22.737754 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc5a50-d4bf-4636-9261-582b0d613ef7 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:22.772815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bd909-f0bb-46d4-96a5-0374a25965d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:22.773544 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bd909-f0bb-46d4-96a5-0374a25965d2 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:22.773834 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bd909-f0bb-46d4-96a5-0374a25965d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:22.774118 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bd909-f0bb-46d4-96a5-0374a25965d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:22.784162 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bd909-f0bb-46d4-96a5-0374a25965d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-137bd909-f0bb-46d4-96a5-0374a25965d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:18:22.792488 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:22.793654 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:22.794852 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 433/829] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:18:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:22.799704 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad3d6d-6ab3-4b2d-9d99-7f3c6ca97f09 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:22.839892 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:22.899287 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad3d6d-6ab3-4b2d-9d99-7f3c6ca97f09 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:22.935212 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f15186-b126-46cd-af29-9966c8611385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:22.935887 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f15186-b126-46cd-af29-9966c8611385 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:22.936174 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f15186-b126-46cd-af29-9966c8611385 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:22.936455 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f15186-b126-46cd-af29-9966c8611385 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:22.937211 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f15186-b126-46cd-af29-9966c8611385 None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:22.937523 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f15186-b126-46cd-af29-9966c8611385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:22.938937 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f15186-b126-46cd-af29-9966c8611385 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:22.947721 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 397/830] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:18:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:22.953561 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bd909-f0bb-46d4-96a5-0374a25965d2 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:23.003369 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:23.056073 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bd909-f0bb-46d4-96a5-0374a25965d2 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:23.087732 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f41618-a6c2-47ba-948f-b01672b70556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:23.088511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f41618-a6c2-47ba-948f-b01672b70556 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:23.088790 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f41618-a6c2-47ba-948f-b01672b70556 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:23.089123 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f41618-a6c2-47ba-948f-b01672b70556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:23.099225 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f41618-a6c2-47ba-948f-b01672b70556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:23.101249 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f41618-a6c2-47ba-948f-b01672b70556 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-d6f41618-a6c2-47ba-948f-b01672b70556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:23.118735 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:23.124564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:23.125574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:23.125574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:23.125574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:23.125574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:23.125574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 434/831] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:23.126123 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f15186-b126-46cd-af29-9966c8611385 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:23.222882 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:23.226334 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f15186-b126-46cd-af29-9966c8611385 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:23.260118 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5aff8-dfdd-4e06-8f2f-d75a9e683a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:23.260775 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5aff8-dfdd-4e06-8f2f-d75a9e683a56 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:23.261059 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5aff8-dfdd-4e06-8f2f-d75a9e683a56 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:23.261362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5aff8-dfdd-4e06-8f2f-d75a9e683a56 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:23.262073 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5aff8-dfdd-4e06-8f2f-d75a9e683a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:23.262382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5aff8-dfdd-4e06-8f2f-d75a9e683a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:23.263787 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5aff8-dfdd-4e06-8f2f-d75a9e683a56 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:23.275559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 398/832] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:23.281458 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f41618-a6c2-47ba-948f-b01672b70556 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:23.378411 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:23.382485 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f41618-a6c2-47ba-948f-b01672b70556 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:23.416335 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051a02c-9196-4891-ac30-ab3fd871df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:23.417134 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051a02c-9196-4891-ac30-ab3fd871df62 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:23.417417 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051a02c-9196-4891-ac30-ab3fd871df62 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:23.417691 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051a02c-9196-4891-ac30-ab3fd871df62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:23.425241 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051a02c-9196-4891-ac30-ab3fd871df62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:23.426795 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051a02c-9196-4891-ac30-ab3fd871df62 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-d051a02c-9196-4891-ac30-ab3fd871df62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:18:23.441788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:23.442942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:23.443913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 435/833] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:23.448813 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5aff8-dfdd-4e06-8f2f-d75a9e683a56 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:23.549191 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5aff8-dfdd-4e06-8f2f-d75a9e683a56 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:23.582866 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f4253-91ea-4bb5-9bbc-b9a81cc3047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:23.583540 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f4253-91ea-4bb5-9bbc-b9a81cc3047e None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:23.583826 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f4253-91ea-4bb5-9bbc-b9a81cc3047e None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:23.584107 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f4253-91ea-4bb5-9bbc-b9a81cc3047e None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:23.584936 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f4253-91ea-4bb5-9bbc-b9a81cc3047e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:23.585741 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f4253-91ea-4bb5-9bbc-b9a81cc3047e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:23.587284 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f4253-91ea-4bb5-9bbc-b9a81cc3047e None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:23.605267 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 399/834] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 14:18:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:23.610967 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051a02c-9196-4891-ac30-ab3fd871df62 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:23.711256 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051a02c-9196-4891-ac30-ab3fd871df62 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:23.746690 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec0b70-7a2d-48d4-88b6-2b23ad5d34b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:23.747337 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0b70-7a2d-48d4-88b6-2b23ad5d34b9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:23.747621 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0b70-7a2d-48d4-88b6-2b23ad5d34b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:23.747928 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0b70-7a2d-48d4-88b6-2b23ad5d34b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:23.776437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:23.814982 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec0b70-7a2d-48d4-88b6-2b23ad5d34b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:23.816446 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec0b70-7a2d-48d4-88b6-2b23ad5d34b9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:23.916827 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 436/835] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:18:23 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 14:18:23.922686 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f4253-91ea-4bb5-9bbc-b9a81cc3047e None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:23.942495 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:24.021622 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f4253-91ea-4bb5-9bbc-b9a81cc3047e None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:24.056995 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65d32f-097a-4079-b3df-ca3dd4db488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:24.057784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d32f-097a-4079-b3df-ca3dd4db488d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:24.058066 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d32f-097a-4079-b3df-ca3dd4db488d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:24.058341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65d32f-097a-4079-b3df-ca3dd4db488d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:24.068026 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65d32f-097a-4079-b3df-ca3dd4db488d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:24.069532 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65d32f-097a-4079-b3df-ca3dd4db488d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-fd65d32f-097a-4079-b3df-ca3dd4db488d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:24.090417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:24.091570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:24.092688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:24.092688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:24.092688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:24.092688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:24.092688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 400/836] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:24.097789 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec0b70-7a2d-48d4-88b6-2b23ad5d34b9 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:24.164977 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:24.206655 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec0b70-7a2d-48d4-88b6-2b23ad5d34b9 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:24.239369 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad197ef7-2e6b-48ec-9df9-a5f3ae328bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:24.240028 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad197ef7-2e6b-48ec-9df9-a5f3ae328bac None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:24.240318 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad197ef7-2e6b-48ec-9df9-a5f3ae328bac None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:24.240600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad197ef7-2e6b-48ec-9df9-a5f3ae328bac None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:24.241853 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad197ef7-2e6b-48ec-9df9-a5f3ae328bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:24.242404 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad197ef7-2e6b-48ec-9df9-a5f3ae328bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:24.243917 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad197ef7-2e6b-48ec-9df9-a5f3ae328bac None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:24.255501 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 437/837] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:24.262098 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65d32f-097a-4079-b3df-ca3dd4db488d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:24.335987 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:24.365156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65d32f-097a-4079-b3df-ca3dd4db488d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:24.398837 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a0563-205f-4ed6-9e49-17b8467535f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:24.399628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a0563-205f-4ed6-9e49-17b8467535f3 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:24.399912 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a0563-205f-4ed6-9e49-17b8467535f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:24.400188 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a0563-205f-4ed6-9e49-17b8467535f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:24.406552 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a0563-205f-4ed6-9e49-17b8467535f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:24.408038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a0563-205f-4ed6-9e49-17b8467535f3 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-672a0563-205f-4ed6-9e49-17b8467535f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:18:24.423038 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:24.424153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:24.425068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:18:24.425068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:18:24.425068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:18:24.425068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:18:24.425068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:18:24.425068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:18:24.425068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:24.425068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:24.425068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 401/838] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:24.431098 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad197ef7-2e6b-48ec-9df9-a5f3ae328bac None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:24.528946 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad197ef7-2e6b-48ec-9df9-a5f3ae328bac None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:24.546789 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:24.564536 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d58b24-b74c-454c-b12a-c1b888b3626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:24.565206 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d58b24-b74c-454c-b12a-c1b888b3626d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:24.565489 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d58b24-b74c-454c-b12a-c1b888b3626d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:24.565770 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d58b24-b74c-454c-b12a-c1b888b3626d None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:24.566551 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d58b24-b74c-454c-b12a-c1b888b3626d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:24.566899 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d58b24-b74c-454c-b12a-c1b888b3626d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:24.568338 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d58b24-b74c-454c-b12a-c1b888b3626d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:24.579690 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 438/839] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:24.587968 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a0563-205f-4ed6-9e49-17b8467535f3 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:24.688606 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a0563-205f-4ed6-9e49-17b8467535f3 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:24.716314 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:24.722244 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bcb27-583d-433a-a4f0-53f3bb035645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:24.722937 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcb27-583d-433a-a4f0-53f3bb035645 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:24.723224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcb27-583d-433a-a4f0-53f3bb035645 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:24.723503 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcb27-583d-433a-a4f0-53f3bb035645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:24.724362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcb27-583d-433a-a4f0-53f3bb035645 None admin] RBAC: Adding query filter params (role.id=40519a26349f42bc93dc43425e96d7de, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=f2fb1743d8104deea9914b232c944962) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:24.724722 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcb27-583d-433a-a4f0-53f3bb035645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:24.727113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcb27-583d-433a-a4f0-53f3bb035645 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:24.732797 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 402/840] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:18:24 2022] GET /identity/v3/role_assignments?user.id=f2fb1743d8104deea9914b232c944962&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=40519a26349f42bc93dc43425e96d7de => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:27.031977 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38656-1dd9-4464-923d-e0d0b3fd3da5 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:27.032522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38656-1dd9-4464-923d-e0d0b3fd3da5 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:27.032628 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38656-1dd9-4464-923d-e0d0b3fd3da5 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:27.034046 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 439/841] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:27.039891 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a6c1d-94fe-4ed3-a9a3-ddb49fbec27b None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:27.040344 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a6c1d-94fe-4ed3-a9a3-ddb49fbec27b None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:27.040436 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a6c1d-94fe-4ed3-a9a3-ddb49fbec27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:27.057552 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-c83a6c1d-94fe-4ed3-a9a3-ddb49fbec27b None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:27.058794 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-c83a6c1d-94fe-4ed3-a9a3-ddb49fbec27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:27.125354 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 403/842] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:27 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:27.150071 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf38656-1dd9-4464-923d-e0d0b3fd3da5 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:27.254426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf38656-1dd9-4464-923d-e0d0b3fd3da5 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:27.290831 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5f414-7e75-4319-a55f-694e09b73dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:27.291625 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5f414-7e75-4319-a55f-694e09b73dad None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:27.291916 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5f414-7e75-4319-a55f-694e09b73dad None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:27.292198 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5f414-7e75-4319-a55f-694e09b73dad None admin] PATH_INFO: `/v3/roles/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:27.302309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5f414-7e75-4319-a55f-694e09b73dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-c0d5f414-7e75-4319-a55f-694e09b73dad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:18:27.311005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:27.311986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:27.312821 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 440/843] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:27.318298 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a6c1d-94fe-4ed3-a9a3-ddb49fbec27b None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:27.424355 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a6c1d-94fe-4ed3-a9a3-ddb49fbec27b None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:27.448615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:27.459001 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e4051-61a1-4f3e-9421-8307c19d217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:27.459673 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e4051-61a1-4f3e-9421-8307c19d217f None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:27.459977 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e4051-61a1-4f3e-9421-8307c19d217f None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:27.460852 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e4051-61a1-4f3e-9421-8307c19d217f None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:27.461606 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e4051-61a1-4f3e-9421-8307c19d217f None admin] RBAC: Adding query filter params (name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:27.461916 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e4051-61a1-4f3e-9421-8307c19d217f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:27.463342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e4051-61a1-4f3e-9421-8307c19d217f None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:27.471207 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 404/844] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:27.477396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5f414-7e75-4319-a55f-694e09b73dad None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:27.518210 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:27.578132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5f414-7e75-4319-a55f-694e09b73dad None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:27.613252 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4d054-93f8-4043-8417-be44318f9168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:27.614067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4d054-93f8-4043-8417-be44318f9168 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:27.614347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4d054-93f8-4043-8417-be44318f9168 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:27.614618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4d054-93f8-4043-8417-be44318f9168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:27.624871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4d054-93f8-4043-8417-be44318f9168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:27.626339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4d054-93f8-4043-8417-be44318f9168 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-f7e4d054-93f8-4043-8417-be44318f9168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:27.644601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:27.645644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:27.646741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:27.646741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:27.646741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:27.646741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:27.646741 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 441/845] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:27.652218 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e4051-61a1-4f3e-9421-8307c19d217f None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:27.750150 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e4051-61a1-4f3e-9421-8307c19d217f None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:27.785106 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e5cfe-b4e5-4183-978f-90591966ff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:27.785760 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e5cfe-b4e5-4183-978f-90591966ff36 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:27.786036 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e5cfe-b4e5-4183-978f-90591966ff36 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:27.786308 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e5cfe-b4e5-4183-978f-90591966ff36 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:27.787045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e5cfe-b4e5-4183-978f-90591966ff36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:27.787371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e5cfe-b4e5-4183-978f-90591966ff36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:27.788859 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e5cfe-b4e5-4183-978f-90591966ff36 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:27.800990 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 405/846] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:27.807387 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4d054-93f8-4043-8417-be44318f9168 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:27.902385 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:27.911800 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4d054-93f8-4043-8417-be44318f9168 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:27.945672 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e5ea-53e6-45f7-95b0-411d9ce93ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:27.946465 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e5ea-53e6-45f7-95b0-411d9ce93ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:27.946776 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e5ea-53e6-45f7-95b0-411d9ce93ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:27.947053 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478e5ea-53e6-45f7-95b0-411d9ce93ee3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:27.953954 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478e5ea-53e6-45f7-95b0-411d9ce93ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:27.955425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478e5ea-53e6-45f7-95b0-411d9ce93ee3 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-c478e5ea-53e6-45f7-95b0-411d9ce93ee3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:18:27.970184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:27.973614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:27.974600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 442/847] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:27.977265 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e5cfe-b4e5-4183-978f-90591966ff36 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:28.024760 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:28.079627 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e5cfe-b4e5-4183-978f-90591966ff36 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:28.113806 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e50372-be0f-4521-88e0-c904dba7213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:28.114470 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50372-be0f-4521-88e0-c904dba7213b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:28.114783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50372-be0f-4521-88e0-c904dba7213b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:28.115059 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e50372-be0f-4521-88e0-c904dba7213b None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:28.115880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e50372-be0f-4521-88e0-c904dba7213b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:28.116764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e50372-be0f-4521-88e0-c904dba7213b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:28.118214 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e50372-be0f-4521-88e0-c904dba7213b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:28.135930 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 406/848] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 14:18:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:28.141847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e5ea-53e6-45f7-95b0-411d9ce93ee3 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:28.241130 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478e5ea-53e6-45f7-95b0-411d9ce93ee3 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:28.274612 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca42d9c-e27e-4745-a39e-802bda674fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:28.275467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca42d9c-e27e-4745-a39e-802bda674fc2 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:28.275705 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca42d9c-e27e-4745-a39e-802bda674fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:28.275978 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca42d9c-e27e-4745-a39e-802bda674fc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:28.285691 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca42d9c-e27e-4745-a39e-802bda674fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:28.287188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca42d9c-e27e-4745-a39e-802bda674fc2 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-dca42d9c-e27e-4745-a39e-802bda674fc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:28.305378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:28.306268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:28.307169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:28.307169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:28.307169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:28.307169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:28.307169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 443/849] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:28.312405 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e50372-be0f-4521-88e0-c904dba7213b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:28.414885 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e50372-be0f-4521-88e0-c904dba7213b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:28.417228 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:28.449223 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b698dc6-6f3e-4e8d-b11c-846541e0b9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:28.449885 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b698dc6-6f3e-4e8d-b11c-846541e0b9d7 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:28.450166 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b698dc6-6f3e-4e8d-b11c-846541e0b9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:28.450438 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b698dc6-6f3e-4e8d-b11c-846541e0b9d7 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:28.451522 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b698dc6-6f3e-4e8d-b11c-846541e0b9d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:28.451871 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b698dc6-6f3e-4e8d-b11c-846541e0b9d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:28.453597 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b698dc6-6f3e-4e8d-b11c-846541e0b9d7 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:28.465171 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 407/850] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:28.470820 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca42d9c-e27e-4745-a39e-802bda674fc2 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:28.473709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:28.570162 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca42d9c-e27e-4745-a39e-802bda674fc2 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:28.603344 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13f192-2e2a-49c5-ac00-2a27fcd9ef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:28.604125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13f192-2e2a-49c5-ac00-2a27fcd9ef0f None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:28.604407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13f192-2e2a-49c5-ac00-2a27fcd9ef0f None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:28.604679 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13f192-2e2a-49c5-ac00-2a27fcd9ef0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:28.611405 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13f192-2e2a-49c5-ac00-2a27fcd9ef0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:28.612867 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13f192-2e2a-49c5-ac00-2a27fcd9ef0f None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-4e13f192-2e2a-49c5-ac00-2a27fcd9ef0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:18:28.627052 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:28.628569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:28.629638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:18:28.629638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:18:28.629638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:18:28.629638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:18:28.629638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:18:28.629638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:18:28.629638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:28.629638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:28.629638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 444/851] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:28.634255 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b698dc6-6f3e-4e8d-b11c-846541e0b9d7 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:28.735572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b698dc6-6f3e-4e8d-b11c-846541e0b9d7 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:28.768558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7ff3b-28df-49fd-ad6b-756e1c834b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:28.769216 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7ff3b-28df-49fd-ad6b-756e1c834b14 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:28.769501 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7ff3b-28df-49fd-ad6b-756e1c834b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:28.769777 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7ff3b-28df-49fd-ad6b-756e1c834b14 None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:28.770558 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7ff3b-28df-49fd-ad6b-756e1c834b14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:28.770947 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7ff3b-28df-49fd-ad6b-756e1c834b14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:28.772923 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7ff3b-28df-49fd-ad6b-756e1c834b14 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:28.786014 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 408/852] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:28.792541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13f192-2e2a-49c5-ac00-2a27fcd9ef0f None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:28.857142 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:28.894655 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13f192-2e2a-49c5-ac00-2a27fcd9ef0f None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:28.928037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249a535-3dbd-4916-978a-bbf18663d940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:28.929117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249a535-3dbd-4916-978a-bbf18663d940 None admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:28.929399 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249a535-3dbd-4916-978a-bbf18663d940 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:28.929680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249a535-3dbd-4916-978a-bbf18663d940 None admin] PATH_INFO: `/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/f2fb1743d8104deea9914b232c944962/roles/40519a26349f42bc93dc43425e96d7de` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:28.944849 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249a535-3dbd-4916-978a-bbf18663d940 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5992534cc13499cb1ae95958d96ca9c, user_id=f2fb1743d8104deea9914b232c944962, role_id=40519a26349f42bc93dc43425e96d7de)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:28.946525 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249a535-3dbd-4916-978a-bbf18663d940 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:29.081698 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 445/853] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:18:28 2022] PUT /identity/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/f2fb1743d8104deea9914b232c944962/roles/40519a26349f42bc93dc43425e96d7de => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:18:31.403429 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac949e24-33fd-4c2b-a461-df052479c2be None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:31.403974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac949e24-33fd-4c2b-a461-df052479c2be None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:31.404086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac949e24-33fd-4c2b-a461-df052479c2be None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:31.405372 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 409/854] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:31.410830 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3819cc-3a51-43fc-9517-b7c044415e89 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:31.411222 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3819cc-3a51-43fc-9517-b7c044415e89 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:31.411384 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3819cc-3a51-43fc-9517-b7c044415e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:31.428290 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-ec3819cc-3a51-43fc-9517-b7c044415e89 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:31.433425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-ec3819cc-3a51-43fc-9517-b7c044415e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:31.509824 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 446/855] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:31 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:31.535200 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac949e24-33fd-4c2b-a461-df052479c2be None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:31.561765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:31.638242 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac949e24-33fd-4c2b-a461-df052479c2be None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:31.670788 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fe148-9dce-418c-af8a-ff25ea0ab328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:31.671508 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fe148-9dce-418c-af8a-ff25ea0ab328 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:31.671791 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fe148-9dce-418c-af8a-ff25ea0ab328 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:31.672064 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fe148-9dce-418c-af8a-ff25ea0ab328 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:31.682488 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fe148-9dce-418c-af8a-ff25ea0ab328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-2e0fe148-9dce-418c-af8a-ff25ea0ab328 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:18:31.690268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:31.691440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:31.692423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 410/856] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Jun 2 14:18:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:31.698320 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3819cc-3a51-43fc-9517-b7c044415e89 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:31.743092 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:31.799126 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3819cc-3a51-43fc-9517-b7c044415e89 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:31.833865 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6631b5-d6bd-42fb-b28b-482fa01d2af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:31.834522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6631b5-d6bd-42fb-b28b-482fa01d2af4 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:31.834888 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6631b5-d6bd-42fb-b28b-482fa01d2af4 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:31.835288 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6631b5-d6bd-42fb-b28b-482fa01d2af4 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:31.836116 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6631b5-d6bd-42fb-b28b-482fa01d2af4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:31.836425 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6631b5-d6bd-42fb-b28b-482fa01d2af4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:31.837783 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6631b5-d6bd-42fb-b28b-482fa01d2af4 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:31.845552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 447/857] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Jun 2 14:18:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:31.851543 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fe148-9dce-418c-af8a-ff25ea0ab328 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:31.940391 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:31.956859 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fe148-9dce-418c-af8a-ff25ea0ab328 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:31.990881 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f9016-2d86-4803-b5b5-428a51762d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:31.992349 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f9016-2d86-4803-b5b5-428a51762d66 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:31.992626 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f9016-2d86-4803-b5b5-428a51762d66 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:31.992898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f9016-2d86-4803-b5b5-428a51762d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:32.003297 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f9016-2d86-4803-b5b5-428a51762d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:32.004747 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f9016-2d86-4803-b5b5-428a51762d66 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-dc5f9016-2d86-4803-b5b5-428a51762d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:32.021592 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:32.022559 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:32.031255 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:32.031255 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:32.031255 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:32.031255 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:32.031255 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 411/858] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:32.031635 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6631b5-d6bd-42fb-b28b-482fa01d2af4 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:32.129748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6631b5-d6bd-42fb-b28b-482fa01d2af4 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:32.132330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:32.162769 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6c2f4-1ed0-4da6-a8e7-c9169e1492f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:32.164229 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c2f4-1ed0-4da6-a8e7-c9169e1492f7 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:32.164512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c2f4-1ed0-4da6-a8e7-c9169e1492f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:32.164786 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c2f4-1ed0-4da6-a8e7-c9169e1492f7 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:32.165502 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6c2f4-1ed0-4da6-a8e7-c9169e1492f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:32.165811 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6c2f4-1ed0-4da6-a8e7-c9169e1492f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:32.167247 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6c2f4-1ed0-4da6-a8e7-c9169e1492f7 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:32.178298 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 448/859] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:32.184621 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f9016-2d86-4803-b5b5-428a51762d66 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:32.289180 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f9016-2d86-4803-b5b5-428a51762d66 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:32.323423 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dc5ee-0c35-427c-b1bc-00d89c27c8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:32.324231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dc5ee-0c35-427c-b1bc-00d89c27c8ca None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:32.324516 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dc5ee-0c35-427c-b1bc-00d89c27c8ca None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:32.324796 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dc5ee-0c35-427c-b1bc-00d89c27c8ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:32.327519 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:32.332522 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dc5ee-0c35-427c-b1bc-00d89c27c8ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:32.333970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dc5ee-0c35-427c-b1bc-00d89c27c8ca None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-de5dc5ee-0c35-427c-b1bc-00d89c27c8ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:18:32.348459 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:32.352193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:32.353364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 412/860] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:32.356453 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6c2f4-1ed0-4da6-a8e7-c9169e1492f7 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:32.458212 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6c2f4-1ed0-4da6-a8e7-c9169e1492f7 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:32.493890 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aba4f2-f222-467c-bf0c-e858580daa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:32.494666 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aba4f2-f222-467c-bf0c-e858580daa0a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:32.494968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aba4f2-f222-467c-bf0c-e858580daa0a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:32.495268 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aba4f2-f222-467c-bf0c-e858580daa0a None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:32.496163 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aba4f2-f222-467c-bf0c-e858580daa0a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:32.496476 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aba4f2-f222-467c-bf0c-e858580daa0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:32.497920 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aba4f2-f222-467c-bf0c-e858580daa0a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:32.516139 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 449/861] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 14:18:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:32.521858 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dc5ee-0c35-427c-b1bc-00d89c27c8ca None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:32.621058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dc5ee-0c35-427c-b1bc-00d89c27c8ca None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:32.654331 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2c044-9535-4823-9976-694367f4a354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:32.655004 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c044-9535-4823-9976-694367f4a354 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:32.655291 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c044-9535-4823-9976-694367f4a354 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:32.655568 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c044-9535-4823-9976-694367f4a354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:32.717077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:32.723486 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2c044-9535-4823-9976-694367f4a354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:32.724971 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2c044-9535-4823-9976-694367f4a354 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:32.829913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 413/862] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:18:32 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 14:18:32.835794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aba4f2-f222-467c-bf0c-e858580daa0a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:32.859979 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:32.934445 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aba4f2-f222-467c-bf0c-e858580daa0a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:32.968466 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f33628-b87c-4045-b8d1-f1f647cd4d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:32.969259 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33628-b87c-4045-b8d1-f1f647cd4d42 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:32.969541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33628-b87c-4045-b8d1-f1f647cd4d42 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:32.969815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33628-b87c-4045-b8d1-f1f647cd4d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:32.979742 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f33628-b87c-4045-b8d1-f1f647cd4d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:32.981185 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f33628-b87c-4045-b8d1-f1f647cd4d42 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-c7f33628-b87c-4045-b8d1-f1f647cd4d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:32.998454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:33.005035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:33.006433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:33.006433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:33.006433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:33.006433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:33.006433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 450/863] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:33.007295 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2c044-9535-4823-9976-694367f4a354 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:33.101049 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:33.106776 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2c044-9535-4823-9976-694367f4a354 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:33.146166 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9bbe6-0c93-4af3-aff9-d4ccb0cf2539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:33.146803 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9bbe6-0c93-4af3-aff9-d4ccb0cf2539 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:33.147089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9bbe6-0c93-4af3-aff9-d4ccb0cf2539 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:33.147421 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9bbe6-0c93-4af3-aff9-d4ccb0cf2539 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:33.148182 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9bbe6-0c93-4af3-aff9-d4ccb0cf2539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:33.148489 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9bbe6-0c93-4af3-aff9-d4ccb0cf2539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:33.149877 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9bbe6-0c93-4af3-aff9-d4ccb0cf2539 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:33.160915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 414/864] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:33.166757 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f33628-b87c-4045-b8d1-f1f647cd4d42 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:33.240791 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:33.265951 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f33628-b87c-4045-b8d1-f1f647cd4d42 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:33.297874 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36313a-f8ca-441d-8abe-8fddbe3e67c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:33.298826 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36313a-f8ca-441d-8abe-8fddbe3e67c8 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:33.299113 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36313a-f8ca-441d-8abe-8fddbe3e67c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:33.299392 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36313a-f8ca-441d-8abe-8fddbe3e67c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:33.306753 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36313a-f8ca-441d-8abe-8fddbe3e67c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:33.308310 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36313a-f8ca-441d-8abe-8fddbe3e67c8 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-8c36313a-f8ca-441d-8abe-8fddbe3e67c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:18:33.323219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:33.324296 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:33.329804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:18:33.329804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:18:33.329804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:18:33.329804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:18:33.329804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:18:33.329804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:18:33.329804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:33.329804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:33.329804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 451/865] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:18:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:33.330384 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9bbe6-0c93-4af3-aff9-d4ccb0cf2539 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:33.430438 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9bbe6-0c93-4af3-aff9-d4ccb0cf2539 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:33.468305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4022d6-c1ae-48d7-8684-0ec367a700fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:33.468992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4022d6-c1ae-48d7-8684-0ec367a700fe None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:33.469287 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4022d6-c1ae-48d7-8684-0ec367a700fe None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:33.469590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4022d6-c1ae-48d7-8684-0ec367a700fe None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:33.470398 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4022d6-c1ae-48d7-8684-0ec367a700fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:33.470747 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4022d6-c1ae-48d7-8684-0ec367a700fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:33.472264 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4022d6-c1ae-48d7-8684-0ec367a700fe None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:33.485432 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 415/866] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:18:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:33.492451 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36313a-f8ca-441d-8abe-8fddbe3e67c8 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:33.593352 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36313a-f8ca-441d-8abe-8fddbe3e67c8 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:33.627049 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b486133-60e7-4b05-b1e4-ec171606bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:33.627697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b486133-60e7-4b05-b1e4-ec171606bab1 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:33.627982 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b486133-60e7-4b05-b1e4-ec171606bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:33.628258 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b486133-60e7-4b05-b1e4-ec171606bab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:33.629078 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b486133-60e7-4b05-b1e4-ec171606bab1 None admin] RBAC: Adding query filter params (role.id=40519a26349f42bc93dc43425e96d7de, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=f2fb1743d8104deea9914b232c944962) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:33.629388 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b486133-60e7-4b05-b1e4-ec171606bab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:33.631096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b486133-60e7-4b05-b1e4-ec171606bab1 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:33.633506 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:33.637872 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 452/867] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:18:33 2022] GET /identity/v3/role_assignments?user.id=f2fb1743d8104deea9914b232c944962&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=40519a26349f42bc93dc43425e96d7de => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:36.020616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54065667-e8e0-46c0-bb8b-b34c12604203 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:36.021138 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54065667-e8e0-46c0-bb8b-b34c12604203 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:36.021138 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54065667-e8e0-46c0-bb8b-b34c12604203 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:36.022693 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 416/868] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:36.028055 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4787e-60fa-4ec3-9b3a-9cfcae1e4080 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:36.028461 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4787e-60fa-4ec3-9b3a-9cfcae1e4080 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:36.028614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4787e-60fa-4ec3-9b3a-9cfcae1e4080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:36.045811 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-5dc4787e-60fa-4ec3-9b3a-9cfcae1e4080 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:36.047436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-5dc4787e-60fa-4ec3-9b3a-9cfcae1e4080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:36.115402 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 453/869] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:36.139812 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54065667-e8e0-46c0-bb8b-b34c12604203 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:36.158767 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:36.240480 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54065667-e8e0-46c0-bb8b-b34c12604203 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:36.275754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df073536-012c-4924-8ba9-dba14b84957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:36.276593 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df073536-012c-4924-8ba9-dba14b84957b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:36.276882 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df073536-012c-4924-8ba9-dba14b84957b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:36.277166 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df073536-012c-4924-8ba9-dba14b84957b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:36.287250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df073536-012c-4924-8ba9-dba14b84957b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-df073536-012c-4924-8ba9-dba14b84957b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:18:36.295690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:36.296700 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:36.297518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 417/870] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:36.303246 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4787e-60fa-4ec3-9b3a-9cfcae1e4080 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:36.402670 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4787e-60fa-4ec3-9b3a-9cfcae1e4080 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:36.430218 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:36.437875 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34953d2-4f5d-4c8c-b4c1-0c7d88d2d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:36.438540 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34953d2-4f5d-4c8c-b4c1-0c7d88d2d031 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:36.441366 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34953d2-4f5d-4c8c-b4c1-0c7d88d2d031 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:36.441366 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34953d2-4f5d-4c8c-b4c1-0c7d88d2d031 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:36.441366 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34953d2-4f5d-4c8c-b4c1-0c7d88d2d031 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:36.441366 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34953d2-4f5d-4c8c-b4c1-0c7d88d2d031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:36.441685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34953d2-4f5d-4c8c-b4c1-0c7d88d2d031 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:36.449921 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 454/871] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:18:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:36.455718 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df073536-012c-4924-8ba9-dba14b84957b None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:36.533907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:36.556212 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df073536-012c-4924-8ba9-dba14b84957b None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:36.589970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b32bf-079d-49c1-95f2-9a6361a32755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:36.590816 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b32bf-079d-49c1-95f2-9a6361a32755 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:36.591105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b32bf-079d-49c1-95f2-9a6361a32755 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:36.591385 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b32bf-079d-49c1-95f2-9a6361a32755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:36.602924 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b32bf-079d-49c1-95f2-9a6361a32755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:36.604393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b32bf-079d-49c1-95f2-9a6361a32755 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-401b32bf-079d-49c1-95f2-9a6361a32755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:36.621780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:36.622831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:36.623974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:36.623974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:36.623974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:36.623974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:36.623974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 418/872] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:36.628966 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34953d2-4f5d-4c8c-b4c1-0c7d88d2d031 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:36.733713 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34953d2-4f5d-4c8c-b4c1-0c7d88d2d031 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:36.767297 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57b50e-6555-4ba9-9fe7-c1ca39f33246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:36.767956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57b50e-6555-4ba9-9fe7-c1ca39f33246 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:36.768244 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57b50e-6555-4ba9-9fe7-c1ca39f33246 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:36.768523 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57b50e-6555-4ba9-9fe7-c1ca39f33246 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:36.769243 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57b50e-6555-4ba9-9fe7-c1ca39f33246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:36.769554 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57b50e-6555-4ba9-9fe7-c1ca39f33246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:36.771048 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57b50e-6555-4ba9-9fe7-c1ca39f33246 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:36.783429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 455/873] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:36.789322 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b32bf-079d-49c1-95f2-9a6361a32755 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:36.890971 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b32bf-079d-49c1-95f2-9a6361a32755 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:36.916826 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:36.924627 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1a5b-9913-4193-8aed-a9f3e65636e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:36.925434 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1a5b-9913-4193-8aed-a9f3e65636e1 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:36.925744 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1a5b-9913-4193-8aed-a9f3e65636e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:36.926026 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1a5b-9913-4193-8aed-a9f3e65636e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:36.934085 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c1a5b-9913-4193-8aed-a9f3e65636e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:36.935599 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c1a5b-9913-4193-8aed-a9f3e65636e1 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-368c1a5b-9913-4193-8aed-a9f3e65636e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:18:36.950557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:36.952345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:36.953827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 419/874] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:36.957798 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57b50e-6555-4ba9-9fe7-c1ca39f33246 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:37.008486 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:37.057153 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57b50e-6555-4ba9-9fe7-c1ca39f33246 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:37.091858 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b4044-21f1-48d6-be4c-ad7a24fb6234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:37.092530 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b4044-21f1-48d6-be4c-ad7a24fb6234 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:37.092812 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b4044-21f1-48d6-be4c-ad7a24fb6234 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:37.093092 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b4044-21f1-48d6-be4c-ad7a24fb6234 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:37.093923 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b4044-21f1-48d6-be4c-ad7a24fb6234 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:37.094236 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b4044-21f1-48d6-be4c-ad7a24fb6234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:37.095707 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b4044-21f1-48d6-be4c-ad7a24fb6234 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:37.114495 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 456/875] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 14:18:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:37.121099 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1a5b-9913-4193-8aed-a9f3e65636e1 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:37.221823 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1a5b-9913-4193-8aed-a9f3e65636e1 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:37.256140 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba139c-fa13-4f33-9777-23cdf95784e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:37.256810 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba139c-fa13-4f33-9777-23cdf95784e0 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:37.257091 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba139c-fa13-4f33-9777-23cdf95784e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:37.257357 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba139c-fa13-4f33-9777-23cdf95784e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:37.312232 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:37.324641 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba139c-fa13-4f33-9777-23cdf95784e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:37.326126 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba139c-fa13-4f33-9777-23cdf95784e0 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:37.427659 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 420/876] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:18:37 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 14:18:37.434137 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b4044-21f1-48d6-be4c-ad7a24fb6234 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:37.542426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b4044-21f1-48d6-be4c-ad7a24fb6234 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:37.551774 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:37.582054 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc46b6-0df3-46fd-b125-a78494413ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:37.582054 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc46b6-0df3-46fd-b125-a78494413ec3 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:37.582054 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc46b6-0df3-46fd-b125-a78494413ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:37.582054 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc46b6-0df3-46fd-b125-a78494413ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:37.589573 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc46b6-0df3-46fd-b125-a78494413ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:37.591069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc46b6-0df3-46fd-b125-a78494413ec3 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-d8dc46b6-0df3-46fd-b125-a78494413ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:37.609574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:37.610614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:37.611844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:37.611844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:37.611844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:37.611844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:37.614791 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 457/877] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:37.616690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba139c-fa13-4f33-9777-23cdf95784e0 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:37.701914 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:37.714426 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba139c-fa13-4f33-9777-23cdf95784e0 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:37.747724 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257221a-2914-4331-85e0-d70158c111c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:37.748362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257221a-2914-4331-85e0-d70158c111c3 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:37.748699 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257221a-2914-4331-85e0-d70158c111c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:37.748965 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257221a-2914-4331-85e0-d70158c111c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:37.749687 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257221a-2914-4331-85e0-d70158c111c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:37.750002 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257221a-2914-4331-85e0-d70158c111c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:37.751443 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257221a-2914-4331-85e0-d70158c111c3 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:37.763585 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 421/878] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:18:37.769354 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc46b6-0df3-46fd-b125-a78494413ec3 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:37.870629 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc46b6-0df3-46fd-b125-a78494413ec3 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:37.905701 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5a9a-33b8-43c3-9cdf-e0c8ef73f363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:37.906501 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5a9a-33b8-43c3-9cdf-e0c8ef73f363 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:37.906819 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5a9a-33b8-43c3-9cdf-e0c8ef73f363 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:37.907103 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5a9a-33b8-43c3-9cdf-e0c8ef73f363 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:37.914395 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c5a9a-33b8-43c3-9cdf-e0c8ef73f363 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:37.915898 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c5a9a-33b8-43c3-9cdf-e0c8ef73f363 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-6e5c5a9a-33b8-43c3-9cdf-e0c8ef73f363 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:18:37.929823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:37.930990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:37.931988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:18:37.931988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:18:37.931988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:18:37.931988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:18:37.931988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:18:37.931988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:18:37.931988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:37.931988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:37.931988 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 458/879] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:18:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 14:18:37.937122 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257221a-2914-4331-85e0-d70158c111c3 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:38.037412 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257221a-2914-4331-85e0-d70158c111c3 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:38.071619 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acdaa2-d905-45f1-8da8-781d0568004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:38.072316 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acdaa2-d905-45f1-8da8-781d0568004c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:38.072601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acdaa2-d905-45f1-8da8-781d0568004c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:38.072874 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acdaa2-d905-45f1-8da8-781d0568004c None admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:38.073673 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acdaa2-d905-45f1-8da8-781d0568004c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:38.073980 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acdaa2-d905-45f1-8da8-781d0568004c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:38.075488 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acdaa2-d905-45f1-8da8-781d0568004c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:38.087923 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 422/880] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:18:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:38.093937 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5a9a-33b8-43c3-9cdf-e0c8ef73f363 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:38.117577 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:38.192500 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5a9a-33b8-43c3-9cdf-e0c8ef73f363 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:38.226206 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15f2db-5fae-447a-a286-8dd7a7afbdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:38.226891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f2db-5fae-447a-a286-8dd7a7afbdfb None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:38.227183 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f2db-5fae-447a-a286-8dd7a7afbdfb None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:38.227464 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f2db-5fae-447a-a286-8dd7a7afbdfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:38.228292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15f2db-5fae-447a-a286-8dd7a7afbdfb None admin] RBAC: Adding query filter params (role.id=61482861f00e45048fc1d45570c4c99b, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=f2fb1743d8104deea9914b232c944962) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:38.228610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15f2db-5fae-447a-a286-8dd7a7afbdfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:38.230039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15f2db-5fae-447a-a286-8dd7a7afbdfb None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:38.235444 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 459/881] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:18:38 2022] GET /identity/v3/role_assignments?user.id=f2fb1743d8104deea9914b232c944962&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=61482861f00e45048fc1d45570c4c99b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:40.517534 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d35b2-22c5-4233-ae43-0cbf2a5fd8ba None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:40.518067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d35b2-22c5-4233-ae43-0cbf2a5fd8ba None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:40.518184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d35b2-22c5-4233-ae43-0cbf2a5fd8ba None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:40.519569 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 423/882] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:40.524869 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea16791-d4cd-48a4-88ae-fefb9f1fc4b0 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:40.525248 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea16791-d4cd-48a4-88ae-fefb9f1fc4b0 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:40.525422 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea16791-d4cd-48a4-88ae-fefb9f1fc4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:40.542420 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-1ea16791-d4cd-48a4-88ae-fefb9f1fc4b0 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:40.543634 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-1ea16791-d4cd-48a4-88ae-fefb9f1fc4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:40.610507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 460/883] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:40 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:40.634080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d35b2-22c5-4233-ae43-0cbf2a5fd8ba None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:40.644993 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:40.733713 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d35b2-22c5-4233-ae43-0cbf2a5fd8ba None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:40.766525 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe34491-daa3-49b7-8612-b54e01dd9c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:40.767340 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe34491-daa3-49b7-8612-b54e01dd9c6c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:40.767668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe34491-daa3-49b7-8612-b54e01dd9c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:40.767896 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe34491-daa3-49b7-8612-b54e01dd9c6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:40.778659 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe34491-daa3-49b7-8612-b54e01dd9c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-1fe34491-daa3-49b7-8612-b54e01dd9c6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:18:40.787413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:40.788974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:18:40.789830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:40.790452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 424/884] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:40.798381 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea16791-d4cd-48a4-88ae-fefb9f1fc4b0 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:40.813843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:40.901081 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea16791-d4cd-48a4-88ae-fefb9f1fc4b0 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:40.934832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bddbc-489a-42a0-9e18-9739ef3d1897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:40.935637 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bddbc-489a-42a0-9e18-9739ef3d1897 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:40.935972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bddbc-489a-42a0-9e18-9739ef3d1897 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:40.936195 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bddbc-489a-42a0-9e18-9739ef3d1897 None admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:40.937413 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bddbc-489a-42a0-9e18-9739ef3d1897 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:40.937976 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bddbc-489a-42a0-9e18-9739ef3d1897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:40.939709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bddbc-489a-42a0-9e18-9739ef3d1897 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:40.948400 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 461/885] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:40.954349 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe34491-daa3-49b7-8612-b54e01dd9c6c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:41.021249 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:41.054568 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe34491-daa3-49b7-8612-b54e01dd9c6c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:41.088600 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9b9d9-a99c-46e5-afba-5409ebad01ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:41.089389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b9d9-a99c-46e5-afba-5409ebad01ce None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:41.089672 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b9d9-a99c-46e5-afba-5409ebad01ce None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:41.089947 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b9d9-a99c-46e5-afba-5409ebad01ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:41.100082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9b9d9-a99c-46e5-afba-5409ebad01ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:41.102314 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9b9d9-a99c-46e5-afba-5409ebad01ce None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-7cd9b9d9-a99c-46e5-afba-5409ebad01ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:41.122202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:41.123187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:41.124197 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:41.124197 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:41.124197 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:41.124197 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:41.124197 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 425/886] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:41.129317 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bddbc-489a-42a0-9e18-9739ef3d1897 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:41.204645 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:41.226934 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bddbc-489a-42a0-9e18-9739ef3d1897 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:41.259524 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69cfc9-80f8-4e62-9786-f92625a6b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:41.260177 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69cfc9-80f8-4e62-9786-f92625a6b2f2 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:41.260462 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69cfc9-80f8-4e62-9786-f92625a6b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:41.260740 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69cfc9-80f8-4e62-9786-f92625a6b2f2 None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:41.261458 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69cfc9-80f8-4e62-9786-f92625a6b2f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:41.261801 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69cfc9-80f8-4e62-9786-f92625a6b2f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:41.263199 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69cfc9-80f8-4e62-9786-f92625a6b2f2 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:41.274552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 462/887] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:41.280110 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9b9d9-a99c-46e5-afba-5409ebad01ce None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:41.381362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9b9d9-a99c-46e5-afba-5409ebad01ce None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:41.400989 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:41.415176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95317b6c-b718-499e-813b-6473ce649685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:41.415977 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95317b6c-b718-499e-813b-6473ce649685 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:41.416272 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95317b6c-b718-499e-813b-6473ce649685 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:41.416549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95317b6c-b718-499e-813b-6473ce649685 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:41.423824 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95317b6c-b718-499e-813b-6473ce649685 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:41.425270 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95317b6c-b718-499e-813b-6473ce649685 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-95317b6c-b718-499e-813b-6473ce649685 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:18:41.439418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:41.444856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:41.446045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 426/888] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:41.446943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69cfc9-80f8-4e62-9786-f92625a6b2f2 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:41.561225 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69cfc9-80f8-4e62-9786-f92625a6b2f2 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:41.594681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a2f52-7c7e-4b12-9645-17afb8f4a8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:41.595350 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2f52-7c7e-4b12-9645-17afb8f4a8a9 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:41.595639 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2f52-7c7e-4b12-9645-17afb8f4a8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:41.595919 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2f52-7c7e-4b12-9645-17afb8f4a8a9 None admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:41.596754 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a2f52-7c7e-4b12-9645-17afb8f4a8a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:41.597067 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a2f52-7c7e-4b12-9645-17afb8f4a8a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:41.598514 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a2f52-7c7e-4b12-9645-17afb8f4a8a9 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:41.601710 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:41.616687 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 463/889] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 14:18:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:41.622607 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95317b6c-b718-499e-813b-6473ce649685 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:41.732856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95317b6c-b718-499e-813b-6473ce649685 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:41.766445 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8654bc-6503-4cf9-a9f7-943f54ad236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:41.767261 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8654bc-6503-4cf9-a9f7-943f54ad236d None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:41.767542 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8654bc-6503-4cf9-a9f7-943f54ad236d None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:41.767813 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8654bc-6503-4cf9-a9f7-943f54ad236d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:41.779403 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8654bc-6503-4cf9-a9f7-943f54ad236d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:41.780868 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8654bc-6503-4cf9-a9f7-943f54ad236d None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-ad8654bc-6503-4cf9-a9f7-943f54ad236d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:41.797875 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:41.798973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:41.799888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:41.799888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:41.799888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:41.799888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:41.799888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 427/890] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:41.809181 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a2f52-7c7e-4b12-9645-17afb8f4a8a9 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:41.915170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a2f52-7c7e-4b12-9645-17afb8f4a8a9 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:41.953461 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1572cd-fa01-4ab3-9e6c-30801fd0af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:41.954124 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1572cd-fa01-4ab3-9e6c-30801fd0af1d None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:41.954410 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1572cd-fa01-4ab3-9e6c-30801fd0af1d None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:41.955900 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1572cd-fa01-4ab3-9e6c-30801fd0af1d None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:41.955900 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1572cd-fa01-4ab3-9e6c-30801fd0af1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:41.955900 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1572cd-fa01-4ab3-9e6c-30801fd0af1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:41.957090 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1572cd-fa01-4ab3-9e6c-30801fd0af1d None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:41.968699 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 464/891] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:41.974381 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8654bc-6503-4cf9-a9f7-943f54ad236d None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:42.005384 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:42.074343 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8654bc-6503-4cf9-a9f7-943f54ad236d None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:42.106608 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1694-1f3e-4ead-847d-ec38b573ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:42.107439 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1694-1f3e-4ead-847d-ec38b573ff0c None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:42.107720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1694-1f3e-4ead-847d-ec38b573ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:42.107992 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1694-1f3e-4ead-847d-ec38b573ff0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:42.114614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1694-1f3e-4ead-847d-ec38b573ff0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:42.116616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1694-1f3e-4ead-847d-ec38b573ff0c None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-d3ce1694-1f3e-4ead-847d-ec38b573ff0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:18:42.131248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:42.133092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:42.134382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:18:42.134382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:18:42.134382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:18:42.134382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:18:42.134382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:18:42.134382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:18:42.134382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:42.134382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:42.134382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 428/892] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:42.139027 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1572cd-fa01-4ab3-9e6c-30801fd0af1d None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:42.195318 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:42.241455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1572cd-fa01-4ab3-9e6c-30801fd0af1d None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:42.274336 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754fb2-a514-4fa2-a6a5-663ebef60e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:42.275027 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754fb2-a514-4fa2-a6a5-663ebef60e30 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:42.275316 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754fb2-a514-4fa2-a6a5-663ebef60e30 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:42.275595 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754fb2-a514-4fa2-a6a5-663ebef60e30 None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:42.276375 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754fb2-a514-4fa2-a6a5-663ebef60e30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:42.276688 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754fb2-a514-4fa2-a6a5-663ebef60e30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:42.278179 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754fb2-a514-4fa2-a6a5-663ebef60e30 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:42.289922 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 465/893] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:42.295870 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1694-1f3e-4ead-847d-ec38b573ff0c None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:42.395965 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:42.406169 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1694-1f3e-4ead-847d-ec38b573ff0c None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:42.448689 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8d9b1-ae52-4bf0-9984-162b93bbd485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:42.449572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d9b1-ae52-4bf0-9984-162b93bbd485 None admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:42.449852 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d9b1-ae52-4bf0-9984-162b93bbd485 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:42.450166 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d9b1-ae52-4bf0-9984-162b93bbd485 None admin] PATH_INFO: `/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/f2fb1743d8104deea9914b232c944962/roles/61482861f00e45048fc1d45570c4c99b` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:42.452255 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8d9b1-ae52-4bf0-9984-162b93bbd485 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5992534cc13499cb1ae95958d96ca9c, user_id=f2fb1743d8104deea9914b232c944962, role_id=61482861f00e45048fc1d45570c4c99b)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:42.453691 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8d9b1-ae52-4bf0-9984-162b93bbd485 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:42.538897 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 429/894] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Jun 2 14:18:42 2022] PUT /identity/v3/projects/e5992534cc13499cb1ae95958d96ca9c/users/f2fb1743d8104deea9914b232c944962/roles/61482861f00e45048fc1d45570c4c99b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:18:44.925021 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3ef01-3843-449e-915e-ab12d86786da None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:44.925587 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3ef01-3843-449e-915e-ab12d86786da None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:44.925587 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3ef01-3843-449e-915e-ab12d86786da None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:44.926986 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 466/895] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:44.932410 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521ea35-5fb7-439b-8bdf-c5d9faaedbe0 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:44.932893 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521ea35-5fb7-439b-8bdf-c5d9faaedbe0 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:44.932995 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521ea35-5fb7-439b-8bdf-c5d9faaedbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:44.949598 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-8521ea35-5fb7-439b-8bdf-c5d9faaedbe0 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:44.950846 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-8521ea35-5fb7-439b-8bdf-c5d9faaedbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:45.017766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 430/896] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:44 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:45.044020 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3ef01-3843-449e-915e-ab12d86786da None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:45.150917 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3ef01-3843-449e-915e-ab12d86786da None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:45.165131 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:45.184538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50629733-d420-4b44-8f5c-1508b4856abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:45.185326 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50629733-d420-4b44-8f5c-1508b4856abb None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:45.185610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50629733-d420-4b44-8f5c-1508b4856abb None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:45.185889 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50629733-d420-4b44-8f5c-1508b4856abb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:45.196473 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50629733-d420-4b44-8f5c-1508b4856abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-50629733-d420-4b44-8f5c-1508b4856abb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 14:18:45.204145 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:45.205156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:45.206487 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 467/897] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Jun 2 14:18:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:45.212623 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521ea35-5fb7-439b-8bdf-c5d9faaedbe0 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:45.296512 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:45.314692 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521ea35-5fb7-439b-8bdf-c5d9faaedbe0 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:45.349386 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b41f3-8f6e-47a7-9c83-cfc6f1b265f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:45.350081 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b41f3-8f6e-47a7-9c83-cfc6f1b265f9 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:45.350432 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b41f3-8f6e-47a7-9c83-cfc6f1b265f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:45.351006 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b41f3-8f6e-47a7-9c83-cfc6f1b265f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:45.351780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b41f3-8f6e-47a7-9c83-cfc6f1b265f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:45.352094 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b41f3-8f6e-47a7-9c83-cfc6f1b265f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:45.353569 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b41f3-8f6e-47a7-9c83-cfc6f1b265f9 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:45.361904 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 431/898] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Jun 2 14:18:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:45.367824 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50629733-d420-4b44-8f5c-1508b4856abb None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:45.468295 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50629733-d420-4b44-8f5c-1508b4856abb None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:45.501655 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e521ce-26e4-47e2-85fd-7051d5b0497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:45.503414 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e521ce-26e4-47e2-85fd-7051d5b0497a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:45.503414 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e521ce-26e4-47e2-85fd-7051d5b0497a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:45.503414 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e521ce-26e4-47e2-85fd-7051d5b0497a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:45.515634 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e521ce-26e4-47e2-85fd-7051d5b0497a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:45.517285 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e521ce-26e4-47e2-85fd-7051d5b0497a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-44e521ce-26e4-47e2-85fd-7051d5b0497a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:45.536396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:45.537455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:45.539008 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:45.539008 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:45.539008 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:45.539008 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:45.539008 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 468/899] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:45.543915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b41f3-8f6e-47a7-9c83-cfc6f1b265f9 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:45.642541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b41f3-8f6e-47a7-9c83-cfc6f1b265f9 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:45.676680 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12324f44-3d51-427d-87bb-5ab9f7fe2a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:45.677345 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324f44-3d51-427d-87bb-5ab9f7fe2a40 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:45.677629 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324f44-3d51-427d-87bb-5ab9f7fe2a40 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:45.677908 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324f44-3d51-427d-87bb-5ab9f7fe2a40 None admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:45.678749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12324f44-3d51-427d-87bb-5ab9f7fe2a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:45.679024 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12324f44-3d51-427d-87bb-5ab9f7fe2a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:45.680396 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12324f44-3d51-427d-87bb-5ab9f7fe2a40 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:45.691859 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 432/900] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:45.697545 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e521ce-26e4-47e2-85fd-7051d5b0497a None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:45.726110 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:45.798228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e521ce-26e4-47e2-85fd-7051d5b0497a None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:45.832016 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625ebd1-2dfb-4bcd-b9a1-d9119c9ae608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:45.832811 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ebd1-2dfb-4bcd-b9a1-d9119c9ae608 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:45.833094 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ebd1-2dfb-4bcd-b9a1-d9119c9ae608 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:45.833374 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ebd1-2dfb-4bcd-b9a1-d9119c9ae608 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:45.841301 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625ebd1-2dfb-4bcd-b9a1-d9119c9ae608 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:45.842802 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625ebd1-2dfb-4bcd-b9a1-d9119c9ae608 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-b625ebd1-2dfb-4bcd-b9a1-d9119c9ae608 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 14:18:45.858725 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:45.860303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:45.861436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 469/901] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:45.866159 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12324f44-3d51-427d-87bb-5ab9f7fe2a40 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:45.870454 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:45.968367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12324f44-3d51-427d-87bb-5ab9f7fe2a40 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:46.001526 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147330-3e52-45f2-9d3f-6e874d53f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:46.002121 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147330-3e52-45f2-9d3f-6e874d53f7e8 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:46.002399 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147330-3e52-45f2-9d3f-6e874d53f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:46.002699 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147330-3e52-45f2-9d3f-6e874d53f7e8 None admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:46.003563 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147330-3e52-45f2-9d3f-6e874d53f7e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:46.003867 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147330-3e52-45f2-9d3f-6e874d53f7e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:46.005290 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147330-3e52-45f2-9d3f-6e874d53f7e8 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:46.023749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 433/902] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Jun 2 14:18:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:46.029600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625ebd1-2dfb-4bcd-b9a1-d9119c9ae608 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:46.113891 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:46.130133 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625ebd1-2dfb-4bcd-b9a1-d9119c9ae608 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:46.164188 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc870-272f-495d-bcf5-1812f9653f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:46.164822 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc870-272f-495d-bcf5-1812f9653f40 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:46.165106 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc870-272f-495d-bcf5-1812f9653f40 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:46.165381 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc870-272f-495d-bcf5-1812f9653f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:46.246116 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc870-272f-495d-bcf5-1812f9653f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:46.248881 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc870-272f-495d-bcf5-1812f9653f40 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:46.332604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:46.347720 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 470/903] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Jun 2 14:18:46 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 14:18:46.353695 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147330-3e52-45f2-9d3f-6e874d53f7e8 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:46.415506 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:46.453680 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147330-3e52-45f2-9d3f-6e874d53f7e8 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:46.487599 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cac562-8666-47de-ae46-50a10b229a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:46.488393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac562-8666-47de-ae46-50a10b229a6a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:46.488678 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac562-8666-47de-ae46-50a10b229a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:46.488951 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac562-8666-47de-ae46-50a10b229a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:46.499332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cac562-8666-47de-ae46-50a10b229a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:46.500741 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cac562-8666-47de-ae46-50a10b229a6a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-98cac562-8666-47de-ae46-50a10b229a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 14:18:46.519328 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:46.520450 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:46.521508 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 14:18:46.521508 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 14:18:46.521508 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 14:18:46.521508 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:46.521508 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 434/904] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:46.527264 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc870-272f-495d-bcf5-1812f9653f40 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:46.625802 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc870-272f-495d-bcf5-1812f9653f40 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:46.659260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1b5df-879b-4963-828f-2019d61bae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:46.659964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b5df-879b-4963-828f-2019d61bae9b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:46.660246 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b5df-879b-4963-828f-2019d61bae9b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:46.660523 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b5df-879b-4963-828f-2019d61bae9b None admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:46.661248 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1b5df-879b-4963-828f-2019d61bae9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:46.661557 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1b5df-879b-4963-828f-2019d61bae9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:46.663745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1b5df-879b-4963-828f-2019d61bae9b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:46.675484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 471/905] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Jun 2 14:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:46.681954 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cac562-8666-47de-ae46-50a10b229a6a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:46.779957 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cac562-8666-47de-ae46-50a10b229a6a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:46.794088 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:46.814424 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dc2b5-7911-411a-9910-3c7948f5843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:46.815254 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dc2b5-7911-411a-9910-3c7948f5843a None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:46.815567 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dc2b5-7911-411a-9910-3c7948f5843a None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:46.815841 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dc2b5-7911-411a-9910-3c7948f5843a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:46.822336 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3dc2b5-7911-411a-9910-3c7948f5843a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:46.823800 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3dc2b5-7911-411a-9910-3c7948f5843a None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application [None req-ab3dc2b5-7911-411a-9910-3c7948f5843a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 14:18:46.838184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:46.841449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:46.842342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 14:18:46.842342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 14:18:46.842342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 14:18:46.842342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 14:18:46.842342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 14:18:46.842342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 14:18:46.842342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 14:18:46.842342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: ERROR keystone.server.flask.application Jun 02 14:18:46.842342 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 435/906] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Jun 2 14:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:46.845722 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1b5df-879b-4963-828f-2019d61bae9b None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:46.895553 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:46.954011 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1b5df-879b-4963-828f-2019d61bae9b None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:46.989609 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42553ac1-4828-4a21-a99a-9f52931b6989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:46.990269 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42553ac1-4828-4a21-a99a-9f52931b6989 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:46.990562 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42553ac1-4828-4a21-a99a-9f52931b6989 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:46.991526 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42553ac1-4828-4a21-a99a-9f52931b6989 None admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:46.992311 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42553ac1-4828-4a21-a99a-9f52931b6989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:46.992650 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42553ac1-4828-4a21-a99a-9f52931b6989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:46.994117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42553ac1-4828-4a21-a99a-9f52931b6989 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:47.007152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 472/907] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Jun 2 14:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:47.013209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dc2b5-7911-411a-9910-3c7948f5843a None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:47.121934 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dc2b5-7911-411a-9910-3c7948f5843a None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:47.160624 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ef808-4175-4ce4-bd4a-2954878dcafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:47.161211 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef808-4175-4ce4-bd4a-2954878dcafa None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:47.161496 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef808-4175-4ce4-bd4a-2954878dcafa None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:47.161773 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef808-4175-4ce4-bd4a-2954878dcafa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:47.163541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ef808-4175-4ce4-bd4a-2954878dcafa None admin] RBAC: Adding query filter params (role.id=61482861f00e45048fc1d45570c4c99b, scope.project.id=e5992534cc13499cb1ae95958d96ca9c, user.id=f2fb1743d8104deea9914b232c944962) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:47.163774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ef808-4175-4ce4-bd4a-2954878dcafa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:47.165318 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ef808-4175-4ce4-bd4a-2954878dcafa None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:47.172199 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 436/908] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Jun 2 14:18:47 2022] GET /identity/v3/role_assignments?user.id=f2fb1743d8104deea9914b232c944962&scope.project.id=e5992534cc13499cb1ae95958d96ca9c&role.id=61482861f00e45048fc1d45570c4c99b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:49.583940 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb903-0358-48fa-88f6-a71ca18fd590 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:49.585020 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb903-0358-48fa-88f6-a71ca18fd590 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:49.585020 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb903-0358-48fa-88f6-a71ca18fd590 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:49.586532 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 473/909] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:49.592017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d11f-6813-4173-8019-0cb9a2dae0dd None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:49.592441 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d11f-6813-4173-8019-0cb9a2dae0dd None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:49.592572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2d11f-6813-4173-8019-0cb9a2dae0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:49.609998 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-2af2d11f-6813-4173-8019-0cb9a2dae0dd None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:49.611285 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-2af2d11f-6813-4173-8019-0cb9a2dae0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:49.640249 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:49.677665 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 437/910] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:49 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:49.701069 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcb903-0358-48fa-88f6-a71ca18fd590 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:49.805564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcb903-0358-48fa-88f6-a71ca18fd590 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:49.813191 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:49.840590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f60ca5-37e9-4373-89bd-f8843d57449b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:49.841648 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f60ca5-37e9-4373-89bd-f8843d57449b None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:49.841927 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f60ca5-37e9-4373-89bd-f8843d57449b None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:49.842198 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f60ca5-37e9-4373-89bd-f8843d57449b None admin] PATH_INFO: `/v3/services/placement` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:49.842882 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f60ca5-37e9-4373-89bd-f8843d57449b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:49.844288 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f60ca5-37e9-4373-89bd-f8843d57449b None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-99f60ca5-37e9-4373-89bd-f8843d57449b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:49.856956 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:49.858184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:49.859322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 474/911] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 14:18:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:49.864354 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2d11f-6813-4173-8019-0cb9a2dae0dd None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:49.966622 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2d11f-6813-4173-8019-0cb9a2dae0dd None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:50.000511 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85314c0e-e953-4afe-b6a6-d471b490594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:50.001179 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314c0e-e953-4afe-b6a6-d471b490594b None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:50.001471 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314c0e-e953-4afe-b6a6-d471b490594b None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:50.001750 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85314c0e-e953-4afe-b6a6-d471b490594b None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:50.002487 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85314c0e-e953-4afe-b6a6-d471b490594b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:50.002833 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85314c0e-e953-4afe-b6a6-d471b490594b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:50.009427 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85314c0e-e953-4afe-b6a6-d471b490594b None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:50.010308 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 438/912] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 2 14:18:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:50.016575 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f60ca5-37e9-4373-89bd-f8843d57449b None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:50.116647 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f60ca5-37e9-4373-89bd-f8843d57449b None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:50.151178 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b287e7-d595-4e22-8e40-ff1949784842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:50.151863 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b287e7-d595-4e22-8e40-ff1949784842 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:50.152144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b287e7-d595-4e22-8e40-ff1949784842 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:50.152418 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b287e7-d595-4e22-8e40-ff1949784842 None admin] PATH_INFO: `/v3/services` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:50.153139 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b287e7-d595-4e22-8e40-ff1949784842 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:50.153443 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b287e7-d595-4e22-8e40-ff1949784842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:50.154964 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b287e7-d595-4e22-8e40-ff1949784842 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:50.159317 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 475/913] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 2 14:18:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:18:52.526302 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518c1b-a7ab-435a-bd6a-4560e4616931 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:52.526948 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518c1b-a7ab-435a-bd6a-4560e4616931 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:52.526948 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518c1b-a7ab-435a-bd6a-4560e4616931 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:52.528318 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 439/914] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:52.533704 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66490d-5353-46a5-93cb-eed6603a7234 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:52.534084 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66490d-5353-46a5-93cb-eed6603a7234 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:52.534258 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66490d-5353-46a5-93cb-eed6603a7234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:52.557992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-1a66490d-5353-46a5-93cb-eed6603a7234 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:52.559232 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-1a66490d-5353-46a5-93cb-eed6603a7234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:52.585649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:52.625945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 476/915] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:52 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:52.651025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18518c1b-a7ab-435a-bd6a-4560e4616931 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:52.682344 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:52.751578 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18518c1b-a7ab-435a-bd6a-4560e4616931 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:52.786573 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65a9b7-e471-4112-89a5-03f085b753d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:52.787261 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65a9b7-e471-4112-89a5-03f085b753d3 None admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:52.787667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65a9b7-e471-4112-89a5-03f085b753d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:52.787984 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65a9b7-e471-4112-89a5-03f085b753d3 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:52.788756 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65a9b7-e471-4112-89a5-03f085b753d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:52.790167 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65a9b7-e471-4112-89a5-03f085b753d3 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:52.869263 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 440/916] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Jun 2 14:18:52 2022] POST /identity/v3/services => generated 246 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:18:55.207675 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1350ec-876b-4eb4-bfd5-e38397ac5200 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:55.208227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1350ec-876b-4eb4-bfd5-e38397ac5200 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:55.208227 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1350ec-876b-4eb4-bfd5-e38397ac5200 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:55.209574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 477/917] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:55.214954 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2695634-0d73-4249-ada7-0d83e057b904 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:55.215433 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2695634-0d73-4249-ada7-0d83e057b904 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:55.215579 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2695634-0d73-4249-ada7-0d83e057b904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:55.233460 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-b2695634-0d73-4249-ada7-0d83e057b904 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:55.234668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-b2695634-0d73-4249-ada7-0d83e057b904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:55.306452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 441/918] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:55 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:55.330133 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1350ec-876b-4eb4-bfd5-e38397ac5200 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:55.433833 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1350ec-876b-4eb4-bfd5-e38397ac5200 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:55.470465 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09154d4-0ee3-4c61-bddf-099dd1fcd6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:55.471238 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09154d4-0ee3-4c61-bddf-099dd1fcd6c6 None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:55.471526 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09154d4-0ee3-4c61-bddf-099dd1fcd6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:55.471805 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09154d4-0ee3-4c61-bddf-099dd1fcd6c6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:55.472455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09154d4-0ee3-4c61-bddf-099dd1fcd6c6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:55.473857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09154d4-0ee3-4c61-bddf-099dd1fcd6c6 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-c09154d4-0ee3-4c61-bddf-099dd1fcd6c6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:55.486910 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:55.488077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:55.488935 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 478/919] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 14:18:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:55.494370 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2695634-0d73-4249-ada7-0d83e057b904 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:55.513036 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:55.592220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2695634-0d73-4249-ada7-0d83e057b904 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:55.625347 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece0a9a-ddcc-4aec-abb2-104b77ebad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:55.626041 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece0a9a-ddcc-4aec-abb2-104b77ebad26 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:55.626457 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece0a9a-ddcc-4aec-abb2-104b77ebad26 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:55.626724 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece0a9a-ddcc-4aec-abb2-104b77ebad26 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:55.627671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece0a9a-ddcc-4aec-abb2-104b77ebad26 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:55.628064 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece0a9a-ddcc-4aec-abb2-104b77ebad26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:55.629754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece0a9a-ddcc-4aec-abb2-104b77ebad26 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:55.636296 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 442/920] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 2 14:18:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:55.642377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09154d4-0ee3-4c61-bddf-099dd1fcd6c6 None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:55.672266 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:55.743989 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09154d4-0ee3-4c61-bddf-099dd1fcd6c6 None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:55.779143 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19367-045e-4250-af96-13683a8d263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:55.779806 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19367-045e-4250-af96-13683a8d263a None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:55.780094 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19367-045e-4250-af96-13683a8d263a None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:55.780373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19367-045e-4250-af96-13683a8d263a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:55.781165 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a19367-045e-4250-af96-13683a8d263a None admin] RBAC: Adding query filter params (interface=public, service_id=97172b8dc7204604bf1461319556a534, region_id=RegionOne) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:55.781481 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a19367-045e-4250-af96-13683a8d263a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:55.782887 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a19367-045e-4250-af96-13683a8d263a None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:55.788133 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 479/921] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Jun 2 14:18:55 2022] GET /identity/v3/endpoints?service_id=97172b8dc7204604bf1461319556a534&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:55.793896 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece0a9a-ddcc-4aec-abb2-104b77ebad26 None admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:55.876730 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:55.897778 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece0a9a-ddcc-4aec-abb2-104b77ebad26 None admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:55.932638 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ada1d-ec53-4703-9ad4-16babd8c3e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:55.933545 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ada1d-ec53-4703-9ad4-16babd8c3e22 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:55.933868 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ada1d-ec53-4703-9ad4-16babd8c3e22 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:55.934181 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ada1d-ec53-4703-9ad4-16babd8c3e22 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:55.934943 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ada1d-ec53-4703-9ad4-16babd8c3e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:55.936465 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ada1d-ec53-4703-9ad4-16babd8c3e22 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:55.943045 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 443/922] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Jun 2 14:18:55 2022] GET /identity/v3/services => generated 1962 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:18:58.248397 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f9a82-67de-4d44-87e0-ae085e902dfc None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:58.248993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f9a82-67de-4d44-87e0-ae085e902dfc None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:58.248993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f9a82-67de-4d44-87e0-ae085e902dfc None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:58.250349 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 480/923] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:18:58.255677 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa9cad-019f-484c-b4f6-b0eb01651f23 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:58.256525 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa9cad-019f-484c-b4f6-b0eb01651f23 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:58.256840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa9cad-019f-484c-b4f6-b0eb01651f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:58.273615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-83fa9cad-019f-484c-b4f6-b0eb01651f23 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:18:58.274892 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-83fa9cad-019f-484c-b4f6-b0eb01651f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:18:58.344001 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 444/924] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:18:58 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 14:18:58.368816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f9a82-67de-4d44-87e0-ae085e902dfc None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:58.461318 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:58.470482 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f9a82-67de-4d44-87e0-ae085e902dfc None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:58.503885 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf2af6-016d-4ca1-ac8b-ab49817459de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:58.504609 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf2af6-016d-4ca1-ac8b-ab49817459de None admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:58.504887 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf2af6-016d-4ca1-ac8b-ab49817459de None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:58.505158 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf2af6-016d-4ca1-ac8b-ab49817459de None admin] PATH_INFO: `/v3/services/placement` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:58.506753 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf2af6-016d-4ca1-ac8b-ab49817459de None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:58.508264 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf2af6-016d-4ca1-ac8b-ab49817459de None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application [None req-02bf2af6-016d-4ca1-ac8b-ab49817459de None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 14:18:58.520459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 14:18:58.521681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application with Lock( Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self._enter() Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application return self.creator() Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application created_value = creator( Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: ERROR keystone.server.flask.application Jun 02 14:18:58.522680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 481/925] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Jun 2 14:18:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 14:18:58.528444 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa9cad-019f-484c-b4f6-b0eb01651f23 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:58.605982 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:18:58.628912 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa9cad-019f-484c-b4f6-b0eb01651f23 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:58.664075 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816d61f-0152-48ef-a446-94d3ba72c205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:58.664762 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816d61f-0152-48ef-a446-94d3ba72c205 None admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:58.665048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816d61f-0152-48ef-a446-94d3ba72c205 None admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:58.665352 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816d61f-0152-48ef-a446-94d3ba72c205 None admin] PATH_INFO: `/v3/services` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:58.666068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816d61f-0152-48ef-a446-94d3ba72c205 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:18:58.666409 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816d61f-0152-48ef-a446-94d3ba72c205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:58.667985 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816d61f-0152-48ef-a446-94d3ba72c205 None admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:58.673176 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 445/926] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Jun 2 14:18:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:18:58.679740 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf2af6-016d-4ca1-ac8b-ab49817459de None admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:18:58.777638 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf2af6-016d-4ca1-ac8b-ab49817459de None admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:18:58.811650 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977a869-85a5-4d95-9df6-590944e24841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:18:58.812306 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a869-85a5-4d95-9df6-590944e24841 None admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:18:58.812594 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a869-85a5-4d95-9df6-590944e24841 None admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:18:58.812876 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a869-85a5-4d95-9df6-590944e24841 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:18:58.813625 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977a869-85a5-4d95-9df6-590944e24841 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:18:58.815032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977a869-85a5-4d95-9df6-590944e24841 None admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:18:58.915184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 482/927] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Jun 2 14:18:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:19:08.690601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=30 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:19:08.909319 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:25:07.547802 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd3c5-7dd8-4785-ae75-7a88fe136d8c None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:07.548396 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd3c5-7dd8-4785-ae75-7a88fe136d8c None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:07.548396 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd3c5-7dd8-4785-ae75-7a88fe136d8c None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:07.549931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 446/928] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:07.555452 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f43ba-f4b6-432f-bd59-fbf192708568 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:07.556000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f43ba-f4b6-432f-bd59-fbf192708568 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:07.556000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f43ba-f4b6-432f-bd59-fbf192708568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:07.686277 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-9f2f43ba-f4b6-432f-bd59-fbf192708568 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:07.687665 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-9f2f43ba-f4b6-432f-bd59-fbf192708568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:07.806978 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 483/929] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:07.859046 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3f8a8-e724-4aa3-9c39-84abd89abbf7 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:07.859654 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3f8a8-e724-4aa3-9c39-84abd89abbf7 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:07.860195 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3f8a8-e724-4aa3-9c39-84abd89abbf7 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:07.863287 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 447/930] 10.222.0.59 () {54 vars in 964 bytes} [Thu Jun 2 14:25:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:07.874962 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394866df-371c-4af5-a5c7-5911da7fdd1f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:07.875933 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394866df-371c-4af5-a5c7-5911da7fdd1f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:07.876738 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394866df-371c-4af5-a5c7-5911da7fdd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:07.958898 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-394866df-371c-4af5-a5c7-5911da7fdd1f None None] MFA Rules not processed for user `85bda15c821448e8b98ae81efb135f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:07.960430 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-394866df-371c-4af5-a5c7-5911da7fdd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:08.008261 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:25:08.048538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 484/931] 10.222.0.59 () {58 vars in 1061 bytes} [Thu Jun 2 14:25:07 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:08.057676 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3f8a8-e724-4aa3-9c39-84abd89abbf7 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:08.077901 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3f8a8-e724-4aa3-9c39-84abd89abbf7 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:08.083637 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033296b-ac21-4910-9956-c4a6ed5d4023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:08.084385 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033296b-ac21-4910-9956-c4a6ed5d4023 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:08.086022 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033296b-ac21-4910-9956-c4a6ed5d4023 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:08.089949 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033296b-ac21-4910-9956-c4a6ed5d4023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:08.099541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033296b-ac21-4910-9956-c4a6ed5d4023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:08.101591 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033296b-ac21-4910-9956-c4a6ed5d4023 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:08.113626 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 448/932] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:10.784407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183fbe3-f231-4e62-9125-316626e107db None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:10.784943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183fbe3-f231-4e62-9125-316626e107db None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:10.784943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183fbe3-f231-4e62-9125-316626e107db None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:10.786360 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 485/933] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:10.791699 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfef7d-f98f-4547-b39e-e6d92f71028b None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:10.792127 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfef7d-f98f-4547-b39e-e6d92f71028b None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:10.792261 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfef7d-f98f-4547-b39e-e6d92f71028b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:10.811025 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-86bfef7d-f98f-4547-b39e-e6d92f71028b None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:10.812210 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-86bfef7d-f98f-4547-b39e-e6d92f71028b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:10.820128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 449/934] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:10.859196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183fbe3-f231-4e62-9125-316626e107db None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:10.869954 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183fbe3-f231-4e62-9125-316626e107db None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:10.874357 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690a6f7-2e9a-4ed1-8dd2-95279bb0113c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:10.875019 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690a6f7-2e9a-4ed1-8dd2-95279bb0113c service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:10.875300 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690a6f7-2e9a-4ed1-8dd2-95279bb0113c service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:10.875573 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690a6f7-2e9a-4ed1-8dd2-95279bb0113c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:10.885346 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690a6f7-2e9a-4ed1-8dd2-95279bb0113c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:10.886763 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690a6f7-2e9a-4ed1-8dd2-95279bb0113c service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:10.897452 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 486/935] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:13.761977 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa8ef-ac56-48df-8cba-94db8f1302a8 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:13.762504 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa8ef-ac56-48df-8cba-94db8f1302a8 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:13.762597 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa8ef-ac56-48df-8cba-94db8f1302a8 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:13.764497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 450/936] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:13.769748 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718df16c-1935-44f3-9640-3101caba6daa None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:13.770131 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718df16c-1935-44f3-9640-3101caba6daa None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:13.770310 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718df16c-1935-44f3-9640-3101caba6daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:13.830344 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-718df16c-1935-44f3-9640-3101caba6daa None None] MFA Rules not processed for user `1ffb3d4925534295a000d01ee5969114`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:13.831601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-718df16c-1935-44f3-9640-3101caba6daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:13.927264 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 487/937] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:13 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:13.968783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aa8ef-ac56-48df-8cba-94db8f1302a8 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:13.979677 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aa8ef-ac56-48df-8cba-94db8f1302a8 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:13.983726 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd9559-b153-4413-83c2-b1efe6f40fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:13.984382 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9559-b153-4413-83c2-b1efe6f40fee service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:13.984668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9559-b153-4413-83c2-b1efe6f40fee service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:13.984946 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9559-b153-4413-83c2-b1efe6f40fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:13.994837 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd9559-b153-4413-83c2-b1efe6f40fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:13.996280 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd9559-b153-4413-83c2-b1efe6f40fee service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:14.006616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 451/938] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:13 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:17.187467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc378d6-72bb-4de5-b325-4aeeccf7324e None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:17.187970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc378d6-72bb-4de5-b325-4aeeccf7324e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:17.187970 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc378d6-72bb-4de5-b325-4aeeccf7324e None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:17.189309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 488/939] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:25:17.194485 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82799-098e-4e5a-98ed-aeb2d1f3b812 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:17.194932 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82799-098e-4e5a-98ed-aeb2d1f3b812 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:17.195076 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a82799-098e-4e5a-98ed-aeb2d1f3b812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:17.212453 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-25a82799-098e-4e5a-98ed-aeb2d1f3b812 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:17.213639 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-25a82799-098e-4e5a-98ed-aeb2d1f3b812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:17.280519 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 452/940] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:17 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:17.319507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc378d6-72bb-4de5-b325-4aeeccf7324e None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:17.330130 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc378d6-72bb-4de5-b325-4aeeccf7324e None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:17.333602 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef6c12-0214-4c77-abe7-95ccbad2c5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:17.334266 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef6c12-0214-4c77-abe7-95ccbad2c5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:17.334551 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef6c12-0214-4c77-abe7-95ccbad2c5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:17.334868 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef6c12-0214-4c77-abe7-95ccbad2c5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:17.344202 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef6c12-0214-4c77-abe7-95ccbad2c5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:17.345644 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef6c12-0214-4c77-abe7-95ccbad2c5e9 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:17.354898 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 489/941] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:17 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:20.759033 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427438-6a03-43eb-9f37-4e6a37d671f9 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:20.766184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427438-6a03-43eb-9f37-4e6a37d671f9 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:20.766184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427438-6a03-43eb-9f37-4e6a37d671f9 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:20.766184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 453/942] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:20.766446 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463747-0b76-40e0-b4d5-077bd01b334e None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:20.766446 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463747-0b76-40e0-b4d5-077bd01b334e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:20.766909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8463747-0b76-40e0-b4d5-077bd01b334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:20.784477 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-d8463747-0b76-40e0-b4d5-077bd01b334e None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:20.785673 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-d8463747-0b76-40e0-b4d5-077bd01b334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:20.793493 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 490/943] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:20.845383 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3beca2-ee16-4697-b715-544441265232 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:20.845678 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3beca2-ee16-4697-b715-544441265232 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:20.845961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3beca2-ee16-4697-b715-544441265232 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:20.847368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 454/944] 10.222.0.59 () {54 vars in 964 bytes} [Thu Jun 2 14:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:20.853169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd249e0-a7ad-4f12-8787-e1da2caf831e None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:20.853461 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd249e0-a7ad-4f12-8787-e1da2caf831e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:20.853747 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd249e0-a7ad-4f12-8787-e1da2caf831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:20.873298 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-7dd249e0-a7ad-4f12-8787-e1da2caf831e None None] MFA Rules not processed for user `85bda15c821448e8b98ae81efb135f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:20.874494 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-7dd249e0-a7ad-4f12-8787-e1da2caf831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:20.884927 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 491/945] 10.222.0.59 () {58 vars in 1061 bytes} [Thu Jun 2 14:25:20 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:20.894110 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3beca2-ee16-4697-b715-544441265232 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:20.905068 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3beca2-ee16-4697-b715-544441265232 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:20.908569 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79beee7f-d3c3-474b-9edc-ed77a073d12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:20.909209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beee7f-d3c3-474b-9edc-ed77a073d12a service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:20.914987 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beee7f-d3c3-474b-9edc-ed77a073d12a service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:20.914987 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79beee7f-d3c3-474b-9edc-ed77a073d12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:20.919722 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beee7f-d3c3-474b-9edc-ed77a073d12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:20.921167 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79beee7f-d3c3-474b-9edc-ed77a073d12a service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:20.930779 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 455/946] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:23.522056 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46e13e-4043-43ad-b53b-c6003b0feabb None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:23.522677 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46e13e-4043-43ad-b53b-c6003b0feabb None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:23.522797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46e13e-4043-43ad-b53b-c6003b0feabb None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:23.524363 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 492/947] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:23.533844 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a169a7-3b77-4408-997c-cddbd27cfa9d None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:23.534334 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a169a7-3b77-4408-997c-cddbd27cfa9d None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:23.534427 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a169a7-3b77-4408-997c-cddbd27cfa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:23.554844 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-22a169a7-3b77-4408-997c-cddbd27cfa9d None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:23.556551 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-22a169a7-3b77-4408-997c-cddbd27cfa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:23.565341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 456/948] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:23.601854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46e13e-4043-43ad-b53b-c6003b0feabb None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:23.613678 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46e13e-4043-43ad-b53b-c6003b0feabb None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:23.617665 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecc43d-d905-46fb-ae5a-a370a275f0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:23.618515 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc43d-d905-46fb-ae5a-a370a275f0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:23.619014 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc43d-d905-46fb-ae5a-a370a275f0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:23.619480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc43d-d905-46fb-ae5a-a370a275f0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:23.629790 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecc43d-d905-46fb-ae5a-a370a275f0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:23.631828 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecc43d-d905-46fb-ae5a-a370a275f0b2 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:23.642803 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 493/949] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:26.074339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964592-79b6-4bfa-8558-fcb20bd78b11 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:26.075497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964592-79b6-4bfa-8558-fcb20bd78b11 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:26.075600 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964592-79b6-4bfa-8558-fcb20bd78b11 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:26.077010 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 457/950] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:26.082293 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399a79-bd2b-4789-abcc-4079387569cc None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:26.082764 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399a79-bd2b-4789-abcc-4079387569cc None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:26.082860 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399a79-bd2b-4789-abcc-4079387569cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:26.101183 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-96399a79-bd2b-4789-abcc-4079387569cc None None] MFA Rules not processed for user `1ffb3d4925534295a000d01ee5969114`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:26.102367 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-96399a79-bd2b-4789-abcc-4079387569cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:26.110299 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 494/951] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:26 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:26.149192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b964592-79b6-4bfa-8558-fcb20bd78b11 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:26.160467 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b964592-79b6-4bfa-8558-fcb20bd78b11 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:26.163974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d23829-3bbf-4155-819c-15f69272fe24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:26.164671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d23829-3bbf-4155-819c-15f69272fe24 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:26.165017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d23829-3bbf-4155-819c-15f69272fe24 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:26.165356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d23829-3bbf-4155-819c-15f69272fe24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:26.174364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d23829-3bbf-4155-819c-15f69272fe24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:26.175806 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d23829-3bbf-4155-819c-15f69272fe24 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:26.185335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 458/952] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:26 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:29.195086 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa897924-71ab-4142-9bdc-84a004a18d6a None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:29.195641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa897924-71ab-4142-9bdc-84a004a18d6a None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:29.195641 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa897924-71ab-4142-9bdc-84a004a18d6a None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:29.196995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 495/953] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:29.203126 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370b6e3-ef19-451c-b630-d9667cfadcf7 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:29.203579 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370b6e3-ef19-451c-b630-d9667cfadcf7 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:29.203682 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370b6e3-ef19-451c-b630-d9667cfadcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:29.209724 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=62 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:25:29.222854 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-e370b6e3-ef19-451c-b630-d9667cfadcf7 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:29.224047 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-e370b6e3-ef19-451c-b630-d9667cfadcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:29.231931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 459/954] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:29.269228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa897924-71ab-4142-9bdc-84a004a18d6a None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:29.280721 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa897924-71ab-4142-9bdc-84a004a18d6a None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:29.284995 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f71637-7926-4b30-bce6-4e4f3732acf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:29.285635 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f71637-7926-4b30-bce6-4e4f3732acf2 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:29.285920 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f71637-7926-4b30-bce6-4e4f3732acf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:29.286196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f71637-7926-4b30-bce6-4e4f3732acf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:29.295534 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f71637-7926-4b30-bce6-4e4f3732acf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:29.296969 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f71637-7926-4b30-bce6-4e4f3732acf2 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:29.306373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 496/955] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:31.756820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d601-27dc-45c6-b76f-2b3ac5d53b37 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:31.757356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d601-27dc-45c6-b76f-2b3ac5d53b37 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:31.757356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d601-27dc-45c6-b76f-2b3ac5d53b37 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:31.758863 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 460/956] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:31.765055 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b72db-783d-4aef-9b93-5ddc6b48f84c None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:31.765510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b72db-783d-4aef-9b93-5ddc6b48f84c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:31.765618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b72db-783d-4aef-9b93-5ddc6b48f84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:31.771769 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:25:31.784091 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-2d3b72db-783d-4aef-9b93-5ddc6b48f84c None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:31.785275 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-2d3b72db-783d-4aef-9b93-5ddc6b48f84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:31.794301 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 497/957] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:31.836890 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3d601-27dc-45c6-b76f-2b3ac5d53b37 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:31.848034 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3d601-27dc-45c6-b76f-2b3ac5d53b37 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:31.851550 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742a148-cd8f-4c73-b684-aa88579dc2d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:31.852184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742a148-cd8f-4c73-b684-aa88579dc2d9 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:31.852462 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742a148-cd8f-4c73-b684-aa88579dc2d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:31.852763 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742a148-cd8f-4c73-b684-aa88579dc2d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:31.862194 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742a148-cd8f-4c73-b684-aa88579dc2d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:31.863650 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742a148-cd8f-4c73-b684-aa88579dc2d9 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:31.873806 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 461/958] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:34.946913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024888a0-16e2-41cf-8036-9304dae94814 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:34.947460 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024888a0-16e2-41cf-8036-9304dae94814 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:34.947460 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024888a0-16e2-41cf-8036-9304dae94814 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:34.948838 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 498/959] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:34.954750 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e4b6-2c65-4d0f-952d-b1627ba59181 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:34.955171 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e4b6-2c65-4d0f-952d-b1627ba59181 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:34.955318 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273e4b6-2c65-4d0f-952d-b1627ba59181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:34.973142 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-0273e4b6-2c65-4d0f-952d-b1627ba59181 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:34.974334 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-0273e4b6-2c65-4d0f-952d-b1627ba59181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:34.982000 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 462/960] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:34 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:35.019513 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024888a0-16e2-41cf-8036-9304dae94814 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:35.030918 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024888a0-16e2-41cf-8036-9304dae94814 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:35.034410 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb4624-6967-4e66-966c-4f5a796bee78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:35.035076 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb4624-6967-4e66-966c-4f5a796bee78 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:35.035357 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb4624-6967-4e66-966c-4f5a796bee78 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:35.035629 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb4624-6967-4e66-966c-4f5a796bee78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:35.044832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb4624-6967-4e66-966c-4f5a796bee78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:35.046440 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb4624-6967-4e66-966c-4f5a796bee78 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:35.056144 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 499/961] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:35 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:39.763837 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b808c-796d-47dc-b241-7f1e9d4a2065 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:39.763837 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b808c-796d-47dc-b241-7f1e9d4a2065 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:39.763837 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b808c-796d-47dc-b241-7f1e9d4a2065 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:39.764507 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 463/962] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:39.769761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e86e19-6165-49c1-9b5d-428913bbad8e None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:39.770179 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e86e19-6165-49c1-9b5d-428913bbad8e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:39.770319 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e86e19-6165-49c1-9b5d-428913bbad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:39.789057 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-81e86e19-6165-49c1-9b5d-428913bbad8e None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:39.790269 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-81e86e19-6165-49c1-9b5d-428913bbad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:39.798281 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 500/963] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:39.838743 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b808c-796d-47dc-b241-7f1e9d4a2065 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:39.849649 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b808c-796d-47dc-b241-7f1e9d4a2065 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:39.853248 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbd58e-af52-4c46-a40d-b9b3aba9d2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:39.853830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbd58e-af52-4c46-a40d-b9b3aba9d2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:39.854114 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbd58e-af52-4c46-a40d-b9b3aba9d2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:39.854392 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbd58e-af52-4c46-a40d-b9b3aba9d2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:39.863487 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbd58e-af52-4c46-a40d-b9b3aba9d2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:39.864912 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbd58e-af52-4c46-a40d-b9b3aba9d2a1 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:39.874938 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 464/964] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:43.200436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57686-05c6-4d27-a03e-3d8226dabdff None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:43.200955 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57686-05c6-4d27-a03e-3d8226dabdff None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:43.200955 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57686-05c6-4d27-a03e-3d8226dabdff None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:43.202245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 501/965] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:43.207502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43592da7-9cd9-4766-ad51-6bc3dfddadf4 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:43.207935 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43592da7-9cd9-4766-ad51-6bc3dfddadf4 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:43.208067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43592da7-9cd9-4766-ad51-6bc3dfddadf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:43.227690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-43592da7-9cd9-4766-ad51-6bc3dfddadf4 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:43.228876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-43592da7-9cd9-4766-ad51-6bc3dfddadf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:43.236736 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 465/966] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:43 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:43.275315 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57686-05c6-4d27-a03e-3d8226dabdff None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:43.286572 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57686-05c6-4d27-a03e-3d8226dabdff None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:43.289990 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9f29d-84ed-4f6a-87dd-124b8642cb56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:43.290615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f29d-84ed-4f6a-87dd-124b8642cb56 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:43.290934 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f29d-84ed-4f6a-87dd-124b8642cb56 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:43.291208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9f29d-84ed-4f6a-87dd-124b8642cb56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:43.300262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9f29d-84ed-4f6a-87dd-124b8642cb56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:43.301687 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9f29d-84ed-4f6a-87dd-124b8642cb56 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:43.311651 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 502/967] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:43 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:48.118913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949fa8-b3bc-4c0e-994a-20860febdead None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:48.119478 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949fa8-b3bc-4c0e-994a-20860febdead None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:48.119478 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949fa8-b3bc-4c0e-994a-20860febdead None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:48.120884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 466/968] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:48.126459 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f9cdc-83f3-411c-a527-e8e638d18577 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:48.128788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f9cdc-83f3-411c-a527-e8e638d18577 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:48.128788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f9cdc-83f3-411c-a527-e8e638d18577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:48.145325 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-6a0f9cdc-83f3-411c-a527-e8e638d18577 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:48.146441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-6a0f9cdc-83f3-411c-a527-e8e638d18577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:48.157897 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 503/969] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:25:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:48.193995 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949fa8-b3bc-4c0e-994a-20860febdead None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:25:48.204961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949fa8-b3bc-4c0e-994a-20860febdead None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:25:48.208499 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a6fb5-5caa-4a83-999e-36678c379252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:25:48.209138 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a6fb5-5caa-4a83-999e-36678c379252 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:48.209420 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a6fb5-5caa-4a83-999e-36678c379252 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:48.209696 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a6fb5-5caa-4a83-999e-36678c379252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:48.219650 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a6fb5-5caa-4a83-999e-36678c379252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:25:48.221108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a6fb5-5caa-4a83-999e-36678c379252 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:25:48.231371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 467/970] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:25:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:25:53.952247 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ff24-2ba3-4aac-831b-217fe545fd57 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:53.953231 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ff24-2ba3-4aac-831b-217fe545fd57 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:53.953730 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ff24-2ba3-4aac-831b-217fe545fd57 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:53.955409 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 504/971] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 14:25:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:53.960671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04199-aafb-41a8-8eb3-cf41ce58b797 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:53.961102 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04199-aafb-41a8-8eb3-cf41ce58b797 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:53.961231 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04199-aafb-41a8-8eb3-cf41ce58b797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:54.006956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-aba04199-aafb-41a8-8eb3-cf41ce58b797 None None] MFA Rules not processed for user `f2fb1743d8104deea9914b232c944962`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:54.008604 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-aba04199-aafb-41a8-8eb3-cf41ce58b797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:54.110887 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 468/972] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 14:25:53 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:25:58.139954 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=20 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:25:58.510838 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe8d07-99dd-4b4d-8ab9-20a4b516cfef None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:58.511199 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe8d07-99dd-4b4d-8ab9-20a4b516cfef None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:58.511890 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe8d07-99dd-4b4d-8ab9-20a4b516cfef None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:58.513438 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 505/973] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 14:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:25:58.519479 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75f2ff-e98b-4512-a411-3dfcad399144 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:25:58.519984 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75f2ff-e98b-4512-a411-3dfcad399144 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:25:58.520278 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75f2ff-e98b-4512-a411-3dfcad399144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:25:58.540508 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-ea75f2ff-e98b-4512-a411-3dfcad399144 None None] MFA Rules not processed for user `f2fb1743d8104deea9914b232c944962`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:25:58.541818 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-ea75f2ff-e98b-4512-a411-3dfcad399144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:25:58.551824 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 469/974] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 14:25:58 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:00.048871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0fd5-d65d-4a94-aad1-0c1ec5f24f18 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:00.049390 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0fd5-d65d-4a94-aad1-0c1ec5f24f18 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:00.049482 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b0fd5-d65d-4a94-aad1-0c1ec5f24f18 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:00.050817 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 506/975] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 14:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:00.055766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7232866-872e-4e6c-9573-882eaacf0cbd None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:00.056199 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7232866-872e-4e6c-9573-882eaacf0cbd None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:00.056335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7232866-872e-4e6c-9573-882eaacf0cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:00.063010 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=69 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:26:00.074978 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-b7232866-872e-4e6c-9573-882eaacf0cbd None None] MFA Rules not processed for user `f2fb1743d8104deea9914b232c944962`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:00.076177 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-b7232866-872e-4e6c-9573-882eaacf0cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:00.084817 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 470/976] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 14:26:00 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:04.116346 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9435-2bc8-4ee0-aeec-d84100faf5a4 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:04.116866 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9435-2bc8-4ee0-aeec-d84100faf5a4 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:04.116977 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9435-2bc8-4ee0-aeec-d84100faf5a4 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:04.118238 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 507/977] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:04.123643 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770fae4-dc93-423f-99f8-fcbe51087913 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:04.124062 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770fae4-dc93-423f-99f8-fcbe51087913 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:04.124251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770fae4-dc93-423f-99f8-fcbe51087913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:04.143492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-c770fae4-dc93-423f-99f8-fcbe51087913 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:04.144673 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-c770fae4-dc93-423f-99f8-fcbe51087913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:04.153401 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 471/978] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:04.224761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dff87f-444c-4655-8431-d6c2ceae7bd6 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:04.225601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dff87f-444c-4655-8431-d6c2ceae7bd6 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:04.226330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dff87f-444c-4655-8431-d6c2ceae7bd6 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:04.227976 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 508/979] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 2 14:26:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:04.237571 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341108-ffad-46a1-bf8d-b224d33680be None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:04.239227 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341108-ffad-46a1-bf8d-b224d33680be None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:04.239227 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341108-ffad-46a1-bf8d-b224d33680be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:04.277158 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-51341108-ffad-46a1-bf8d-b224d33680be None None] MFA Rules not processed for user `d9fa78e7e5be4bdcbd5c79a24895299d`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:04.278449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-51341108-ffad-46a1-bf8d-b224d33680be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:04.359756 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 472/980] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 2 14:26:04 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:04.368293 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dff87f-444c-4655-8431-d6c2ceae7bd6 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:04.382456 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dff87f-444c-4655-8431-d6c2ceae7bd6 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:04.390228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723da909-ef96-409d-836d-d9edbf1e4cde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:04.391105 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723da909-ef96-409d-836d-d9edbf1e4cde service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:04.391551 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723da909-ef96-409d-836d-d9edbf1e4cde service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:04.391968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723da909-ef96-409d-836d-d9edbf1e4cde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:04.405192 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723da909-ef96-409d-836d-d9edbf1e4cde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:04.406922 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723da909-ef96-409d-836d-d9edbf1e4cde service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:04.417182 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 509/981] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:26:06.965932 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98435312-9ee9-41fe-a183-4f6668334ccf None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:06.966452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98435312-9ee9-41fe-a183-4f6668334ccf None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:06.966556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98435312-9ee9-41fe-a183-4f6668334ccf None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:06.968048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 473/982] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:06.973219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83143e66-2f66-4541-9ba2-dcb9786b9c00 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:06.973608 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83143e66-2f66-4541-9ba2-dcb9786b9c00 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:06.973779 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83143e66-2f66-4541-9ba2-dcb9786b9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:06.992806 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-83143e66-2f66-4541-9ba2-dcb9786b9c00 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:06.993996 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-83143e66-2f66-4541-9ba2-dcb9786b9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:07.005305 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 510/983] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:07.052294 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98435312-9ee9-41fe-a183-4f6668334ccf None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:07.066588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98435312-9ee9-41fe-a183-4f6668334ccf None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:07.071758 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4f923-a880-4e18-abf4-e9e6f3d44b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:07.072502 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f923-a880-4e18-abf4-e9e6f3d44b47 service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:07.072893 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f923-a880-4e18-abf4-e9e6f3d44b47 service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:07.073889 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f923-a880-4e18-abf4-e9e6f3d44b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:07.082513 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4f923-a880-4e18-abf4-e9e6f3d44b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:07.084218 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4f923-a880-4e18-abf4-e9e6f3d44b47 service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:07.094428 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 474/984] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:09.914755 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c83439-cc42-4b70-8648-b58ba6b8879e None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:09.915309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c83439-cc42-4b70-8648-b58ba6b8879e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:09.915309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c83439-cc42-4b70-8648-b58ba6b8879e None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:09.916704 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 511/985] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:09.922219 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254d054-38d8-4d13-8681-50fb860f31a8 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:09.922704 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254d054-38d8-4d13-8681-50fb860f31a8 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:09.922835 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254d054-38d8-4d13-8681-50fb860f31a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:09.941830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-a254d054-38d8-4d13-8681-50fb860f31a8 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:09.943155 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-a254d054-38d8-4d13-8681-50fb860f31a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:09.952675 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 475/986] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:10.000339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df20e6-3d3a-438a-ac71-f458afc33bad None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:10.000630 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df20e6-3d3a-438a-ac71-f458afc33bad None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:10.000962 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df20e6-3d3a-438a-ac71-f458afc33bad None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:10.004841 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 512/987] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 2 14:26:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:10.010589 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c184da-80ba-451d-9508-5b4bef5cb722 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:10.011557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c184da-80ba-451d-9508-5b4bef5cb722 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:10.011835 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c184da-80ba-451d-9508-5b4bef5cb722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:10.031146 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-11c184da-80ba-451d-9508-5b4bef5cb722 None None] MFA Rules not processed for user `d9fa78e7e5be4bdcbd5c79a24895299d`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:10.032332 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-11c184da-80ba-451d-9508-5b4bef5cb722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:10.040840 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 476/988] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 2 14:26:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:10.048402 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df20e6-3d3a-438a-ac71-f458afc33bad None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:10.068407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df20e6-3d3a-438a-ac71-f458afc33bad None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:10.073946 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94771028-0aab-477d-ad4f-75dda000727b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:10.074767 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771028-0aab-477d-ad4f-75dda000727b service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:10.075057 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771028-0aab-477d-ad4f-75dda000727b service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:10.075334 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771028-0aab-477d-ad4f-75dda000727b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:10.083786 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94771028-0aab-477d-ad4f-75dda000727b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:10.085575 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94771028-0aab-477d-ad4f-75dda000727b service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:10.095361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 513/989] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:12.782463 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa9d1-13aa-4b22-9159-4e2aa8be632d None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:12.783766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa9d1-13aa-4b22-9159-4e2aa8be632d None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:12.784288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa9d1-13aa-4b22-9159-4e2aa8be632d None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:12.786213 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 477/990] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:12.793025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2064-d7e7-489c-904f-abc9d7f8859f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:12.793590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2064-d7e7-489c-904f-abc9d7f8859f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:12.793590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2064-d7e7-489c-904f-abc9d7f8859f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:12.815102 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-055c2064-d7e7-489c-904f-abc9d7f8859f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:12.816574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-055c2064-d7e7-489c-904f-abc9d7f8859f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:12.826923 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 514/991] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:12.876546 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aa9d1-13aa-4b22-9159-4e2aa8be632d None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:12.900650 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aa9d1-13aa-4b22-9159-4e2aa8be632d None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:12.906546 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c25af-cee9-4af8-99be-3239890d3b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:12.907404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c25af-cee9-4af8-99be-3239890d3b7e service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:12.907847 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c25af-cee9-4af8-99be-3239890d3b7e service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:12.911694 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c25af-cee9-4af8-99be-3239890d3b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:12.918349 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c25af-cee9-4af8-99be-3239890d3b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:12.920226 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c25af-cee9-4af8-99be-3239890d3b7e service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:12.931362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 478/992] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:14.176247 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca748c1-b9c9-4c8e-b69f-254eddddb7bb None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:14.177420 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca748c1-b9c9-4c8e-b69f-254eddddb7bb None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:14.177992 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca748c1-b9c9-4c8e-b69f-254eddddb7bb None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:14.180184 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 515/993] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:14.189828 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644f050-d3b9-4c15-81ee-5414c75735ae None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:14.189828 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644f050-d3b9-4c15-81ee-5414c75735ae None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:14.189828 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644f050-d3b9-4c15-81ee-5414c75735ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:14.218194 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-6644f050-d3b9-4c15-81ee-5414c75735ae None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:14.220701 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-6644f050-d3b9-4c15-81ee-5414c75735ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:14.245496 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 479/994] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:14.628128 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419d92-7a23-4b3a-92dc-7cab438737b4 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:14.628416 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419d92-7a23-4b3a-92dc-7cab438737b4 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:14.628693 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76419d92-7a23-4b3a-92dc-7cab438737b4 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:14.630294 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 516/995] 10.222.0.59 () {54 vars in 963 bytes} [Thu Jun 2 14:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:14.635392 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8473106-9c56-48da-b817-28a1d944ff47 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:14.636364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8473106-9c56-48da-b817-28a1d944ff47 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:14.636649 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8473106-9c56-48da-b817-28a1d944ff47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:14.676145 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-d8473106-9c56-48da-b817-28a1d944ff47 None None] MFA Rules not processed for user `b1518eb388a24af9b85e968802e70237`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:14.677367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-d8473106-9c56-48da-b817-28a1d944ff47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:14.746445 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 480/996] 10.222.0.59 () {58 vars in 1060 bytes} [Thu Jun 2 14:26:14 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:14.753762 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76419d92-7a23-4b3a-92dc-7cab438737b4 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:14.766396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76419d92-7a23-4b3a-92dc-7cab438737b4 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:14.769890 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443fa15-1c0c-4084-8906-34da0332d882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1518eb388a24af9b85e968802e70237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:14.770531 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443fa15-1c0c-4084-8906-34da0332d882 service cinder] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:14.770838 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443fa15-1c0c-4084-8906-34da0332d882 service cinder] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:14.771116 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443fa15-1c0c-4084-8906-34da0332d882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:14.781250 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443fa15-1c0c-4084-8906-34da0332d882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:14.782788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443fa15-1c0c-4084-8906-34da0332d882 service cinder] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:14.793057 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 517/997] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:26:15.543747 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99ff36-5502-491b-a0ab-7baf7ce82fc1 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:15.545158 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99ff36-5502-491b-a0ab-7baf7ce82fc1 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:15.545935 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99ff36-5502-491b-a0ab-7baf7ce82fc1 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:15.547888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 481/998] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:15.554153 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be1dcb-e4fe-4f88-b606-fd31af47a316 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:15.554697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be1dcb-e4fe-4f88-b606-fd31af47a316 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:15.554784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be1dcb-e4fe-4f88-b606-fd31af47a316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:15.573976 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-d2be1dcb-e4fe-4f88-b606-fd31af47a316 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:15.575560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-d2be1dcb-e4fe-4f88-b606-fd31af47a316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:15.584545 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 518/999] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:15.631520 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99ff36-5502-491b-a0ab-7baf7ce82fc1 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:15.640880 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=100 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:26:15.646133 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99ff36-5502-491b-a0ab-7baf7ce82fc1 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:15.652434 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cd1ed-a46b-4a8a-804b-94abc5ad0c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:15.653156 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd1ed-a46b-4a8a-804b-94abc5ad0c54 service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:15.653439 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd1ed-a46b-4a8a-804b-94abc5ad0c54 service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:15.653712 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd1ed-a46b-4a8a-804b-94abc5ad0c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:15.662236 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cd1ed-a46b-4a8a-804b-94abc5ad0c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:15.663962 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cd1ed-a46b-4a8a-804b-94abc5ad0c54 service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:15.674567 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 482/1000] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:18.247890 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484491-8917-49cb-92ae-48a45436d3cc None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:18.248439 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484491-8917-49cb-92ae-48a45436d3cc None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:18.248439 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484491-8917-49cb-92ae-48a45436d3cc None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:18.249788 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 519/1001] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:18.255796 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201414f8-d2d5-4de6-ac7f-b510c9ec2be4 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:18.256537 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201414f8-d2d5-4de6-ac7f-b510c9ec2be4 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:18.256996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201414f8-d2d5-4de6-ac7f-b510c9ec2be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:18.279751 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-201414f8-d2d5-4de6-ac7f-b510c9ec2be4 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:18.281238 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-201414f8-d2d5-4de6-ac7f-b510c9ec2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:18.291193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 483/1002] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:18.337083 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3484491-8917-49cb-92ae-48a45436d3cc None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:18.350973 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3484491-8917-49cb-92ae-48a45436d3cc None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:18.356081 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b3f3c-bc64-43b0-a63a-b9b27ab61d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:18.356809 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b3f3c-bc64-43b0-a63a-b9b27ab61d6c service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:18.357089 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b3f3c-bc64-43b0-a63a-b9b27ab61d6c service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:18.357361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b3f3c-bc64-43b0-a63a-b9b27ab61d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:18.366148 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b3f3c-bc64-43b0-a63a-b9b27ab61d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:18.367810 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b3f3c-bc64-43b0-a63a-b9b27ab61d6c service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:18.378107 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 520/1003] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:21.055475 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d79f4-7090-4903-8ced-02fbf50396ff None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:21.055984 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d79f4-7090-4903-8ced-02fbf50396ff None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:21.055984 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d79f4-7090-4903-8ced-02fbf50396ff None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:21.058291 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 484/1004] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:21.063661 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1b14e-3733-42f5-ad8d-3a89ca662737 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:21.064160 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1b14e-3733-42f5-ad8d-3a89ca662737 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:21.064242 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1b14e-3733-42f5-ad8d-3a89ca662737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:21.083034 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-90a1b14e-3733-42f5-ad8d-3a89ca662737 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:21.084230 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-90a1b14e-3733-42f5-ad8d-3a89ca662737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:21.092616 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 521/1005] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:21.135241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d79f4-7090-4903-8ced-02fbf50396ff None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:21.154575 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d79f4-7090-4903-8ced-02fbf50396ff None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:21.159649 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a18f3c-3909-4049-88dc-2f16001a7d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:21.160367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a18f3c-3909-4049-88dc-2f16001a7d8c service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:21.160726 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a18f3c-3909-4049-88dc-2f16001a7d8c service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:21.161268 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a18f3c-3909-4049-88dc-2f16001a7d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:21.170323 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a18f3c-3909-4049-88dc-2f16001a7d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:21.172194 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a18f3c-3909-4049-88dc-2f16001a7d8c service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:21.183267 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 485/1006] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:23.546816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde68605-eae0-4d22-b07c-d2b7159539ad None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:23.547322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde68605-eae0-4d22-b07c-d2b7159539ad None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:23.547322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde68605-eae0-4d22-b07c-d2b7159539ad None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:23.548666 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 522/1007] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:23.553972 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0a3fa-dea8-4982-9ff0-7f6997e49ddc None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:23.554383 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0a3fa-dea8-4982-9ff0-7f6997e49ddc None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:23.554553 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0a3fa-dea8-4982-9ff0-7f6997e49ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:23.573829 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-6db0a3fa-dea8-4982-9ff0-7f6997e49ddc None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:23.575119 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-6db0a3fa-dea8-4982-9ff0-7f6997e49ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:23.583092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 486/1008] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:23.627563 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde68605-eae0-4d22-b07c-d2b7159539ad None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:23.642375 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde68605-eae0-4d22-b07c-d2b7159539ad None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:23.647481 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ecdee-f08b-432a-85f0-ff05a97ed9fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:23.648206 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ecdee-f08b-432a-85f0-ff05a97ed9fd service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:23.648437 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ecdee-f08b-432a-85f0-ff05a97ed9fd service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:23.648728 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ecdee-f08b-432a-85f0-ff05a97ed9fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:23.658325 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ecdee-f08b-432a-85f0-ff05a97ed9fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:23.659998 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ecdee-f08b-432a-85f0-ff05a97ed9fd service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:23.670453 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 523/1009] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:26.467065 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e907-86e2-47bb-b2d0-58a61940cc81 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:26.467065 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e907-86e2-47bb-b2d0-58a61940cc81 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:26.467065 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27e907-86e2-47bb-b2d0-58a61940cc81 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:26.467065 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 487/1010] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:26.468160 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f47a-9c10-4cd8-b645-f30ef49fe78c None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:26.468160 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f47a-9c10-4cd8-b645-f30ef49fe78c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:26.468160 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f47a-9c10-4cd8-b645-f30ef49fe78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:26.480304 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-1219f47a-9c10-4cd8-b645-f30ef49fe78c None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:26.481860 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-1219f47a-9c10-4cd8-b645-f30ef49fe78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:26.492363 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 524/1011] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:26.544386 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27e907-86e2-47bb-b2d0-58a61940cc81 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:26.561897 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27e907-86e2-47bb-b2d0-58a61940cc81 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:26.567442 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775eb344-6aaa-44af-8f2d-70914f759fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:26.568079 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eb344-6aaa-44af-8f2d-70914f759fe3 service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:26.568365 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eb344-6aaa-44af-8f2d-70914f759fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:26.568643 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eb344-6aaa-44af-8f2d-70914f759fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:26.578849 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775eb344-6aaa-44af-8f2d-70914f759fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:26.580571 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775eb344-6aaa-44af-8f2d-70914f759fe3 service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:26.591490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 488/1012] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:30.148914 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37ab36-a771-4caa-bdf5-8603a66a989d None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:30.149602 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37ab36-a771-4caa-bdf5-8603a66a989d None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:30.149602 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37ab36-a771-4caa-bdf5-8603a66a989d None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:30.151958 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 525/1013] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:30.157084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085afad7-c650-4104-899e-65e3cb1268bf None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:30.157521 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085afad7-c650-4104-899e-65e3cb1268bf None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:30.157649 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085afad7-c650-4104-899e-65e3cb1268bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:30.182079 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-085afad7-c650-4104-899e-65e3cb1268bf None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:30.183445 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-085afad7-c650-4104-899e-65e3cb1268bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:30.191305 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 489/1014] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:30.239957 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37ab36-a771-4caa-bdf5-8603a66a989d None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:30.248235 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=46 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:26:30.254892 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37ab36-a771-4caa-bdf5-8603a66a989d None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:30.260651 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece60705-08cf-412e-9dd7-5fb90e61770d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:30.261288 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60705-08cf-412e-9dd7-5fb90e61770d service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:30.261573 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60705-08cf-412e-9dd7-5fb90e61770d service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:30.261849 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece60705-08cf-412e-9dd7-5fb90e61770d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:30.270491 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece60705-08cf-412e-9dd7-5fb90e61770d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:30.272473 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece60705-08cf-412e-9dd7-5fb90e61770d service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:30.282020 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 526/1015] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:31.571645 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24c8ab-d839-4680-b7a5-83a97fd87b34 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:31.572199 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24c8ab-d839-4680-b7a5-83a97fd87b34 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:31.572199 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24c8ab-d839-4680-b7a5-83a97fd87b34 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:31.573931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 490/1016] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:31.579257 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7e7d7-d178-4dce-ba11-5a4f25c71cd6 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:31.579709 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7e7d7-d178-4dce-ba11-5a4f25c71cd6 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:31.579820 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7e7d7-d178-4dce-ba11-5a4f25c71cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:31.599084 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-0ff7e7d7-d178-4dce-ba11-5a4f25c71cd6 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:31.600666 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-0ff7e7d7-d178-4dce-ba11-5a4f25c71cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:31.609093 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 527/1017] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:31.668679 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b362396-f162-460f-9821-e2778923f665 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:31.668970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b362396-f162-460f-9821-e2778923f665 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:31.669253 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b362396-f162-460f-9821-e2778923f665 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:31.670695 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 491/1018] 10.222.0.59 () {54 vars in 962 bytes} [Thu Jun 2 14:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:26:31.675809 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7a836-27be-4144-9c24-ca0406c71d79 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:31.676104 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7a836-27be-4144-9c24-ca0406c71d79 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:31.676389 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7a836-27be-4144-9c24-ca0406c71d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:31.726110 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-04e7a836-27be-4144-9c24-ca0406c71d79 None None] MFA Rules not processed for user `45eae0d918d5451dab9283e2826ffdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:31.727355 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-04e7a836-27be-4144-9c24-ca0406c71d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:31.789395 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 528/1019] 10.222.0.59 () {58 vars in 1059 bytes} [Thu Jun 2 14:26:31 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:31.797804 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b362396-f162-460f-9821-e2778923f665 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:31.808733 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b362396-f162-460f-9821-e2778923f665 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:31.812205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3cbcd-6b8f-4ca3-956c-14ed8098f7d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45eae0d918d5451dab9283e2826ffdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:31.812830 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3cbcd-6b8f-4ca3-956c-14ed8098f7d9 service glance] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:31.813110 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3cbcd-6b8f-4ca3-956c-14ed8098f7d9 service glance] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:31.813381 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3cbcd-6b8f-4ca3-956c-14ed8098f7d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:31.822601 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3cbcd-6b8f-4ca3-956c-14ed8098f7d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:31.824055 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3cbcd-6b8f-4ca3-956c-14ed8098f7d9 service glance] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:31.833487 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 492/1020] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:32.802871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6f70-3641-408e-939c-147faffe88ab None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:32.803563 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6f70-3641-408e-939c-147faffe88ab None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:32.803563 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6f70-3641-408e-939c-147faffe88ab None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:32.804794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 529/1021] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:32.811429 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208df6-3348-4cfb-af7f-028579fe55f9 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:32.811939 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208df6-3348-4cfb-af7f-028579fe55f9 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:32.811939 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208df6-3348-4cfb-af7f-028579fe55f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:32.830590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-c6208df6-3348-4cfb-af7f-028579fe55f9 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:32.831887 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-c6208df6-3348-4cfb-af7f-028579fe55f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:32.841123 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 493/1022] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:26:32.889697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf6f70-3641-408e-939c-147faffe88ab None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:32.906507 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf6f70-3641-408e-939c-147faffe88ab None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:32.911598 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113bad-2316-4f37-957c-a649a3738f60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:32.912239 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113bad-2316-4f37-957c-a649a3738f60 service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:32.912524 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113bad-2316-4f37-957c-a649a3738f60 service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:32.912802 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113bad-2316-4f37-957c-a649a3738f60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:32.922531 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113bad-2316-4f37-957c-a649a3738f60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:32.924155 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113bad-2316-4f37-957c-a649a3738f60 service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:32.934504 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 530/1023] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:35.566222 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d6e4-78d3-404a-8258-57fa02304813 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:35.575440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d6e4-78d3-404a-8258-57fa02304813 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:35.575440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d6e4-78d3-404a-8258-57fa02304813 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:35.575440 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 494/1024] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:35.575737 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0bbd2-0367-44c0-bdf2-0d8b06dd6f2d None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:35.575737 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0bbd2-0367-44c0-bdf2-0d8b06dd6f2d None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:35.575737 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0bbd2-0367-44c0-bdf2-0d8b06dd6f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:35.596039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-c6b0bbd2-0367-44c0-bdf2-0d8b06dd6f2d None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:35.597784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-c6b0bbd2-0367-44c0-bdf2-0d8b06dd6f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:35.614685 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 531/1025] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:26:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:26:35.657889 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923d6e4-78d3-404a-8258-57fa02304813 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:35.672211 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923d6e4-78d3-404a-8258-57fa02304813 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:35.677191 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb32e7-4198-4202-b723-aa29ba695e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:35.677841 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb32e7-4198-4202-b723-aa29ba695e44 service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:35.678128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb32e7-4198-4202-b723-aa29ba695e44 service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:35.678410 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb32e7-4198-4202-b723-aa29ba695e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:35.688291 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb32e7-4198-4202-b723-aa29ba695e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:35.689914 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb32e7-4198-4202-b723-aa29ba695e44 service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:35.700288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 495/1026] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:45.589208 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=55 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:26:45.695672 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=40 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:26:48.410850 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f614d4-9e0c-4d83-b233-6137718dd888 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:48.411511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f614d4-9e0c-4d83-b233-6137718dd888 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:48.411511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f614d4-9e0c-4d83-b233-6137718dd888 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:48.412761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 532/1027] 10.222.0.59 () {54 vars in 918 bytes} [Thu Jun 2 14:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:48.418367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ce84-426a-45df-9aea-ac4ad6f56f4e None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:48.418856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ce84-426a-45df-9aea-ac4ad6f56f4e None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:48.418958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ce84-426a-45df-9aea-ac4ad6f56f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:48.436837 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-7ce1ce84-426a-45df-9aea-ac4ad6f56f4e None None] MFA Rules not processed for user `f2fb1743d8104deea9914b232c944962`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:48.438059 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-7ce1ce84-426a-45df-9aea-ac4ad6f56f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:48.446533 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 496/1028] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Jun 2 14:26:48 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:48.460781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3341de-8589-43cb-8a00-b82bf32da4e4 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:48.461070 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3341de-8589-43cb-8a00-b82bf32da4e4 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:48.461348 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3341de-8589-43cb-8a00-b82bf32da4e4 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:48.462843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 533/1029] 10.222.0.59 () {54 vars in 918 bytes} [Thu Jun 2 14:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:48.467282 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c6fe-8698-4c73-b243-9ddd771a51cb None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:48.467570 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c6fe-8698-4c73-b243-9ddd771a51cb None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:48.467865 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c6fe-8698-4c73-b243-9ddd771a51cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:48.497756 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-8b24c6fe-8698-4c73-b243-9ddd771a51cb None None] MFA Rules not processed for user `d9fa78e7e5be4bdcbd5c79a24895299d`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:48.499009 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-8b24c6fe-8698-4c73-b243-9ddd771a51cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:48.507674 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 497/1030] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Jun 2 14:26:48 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:26:51.352463 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66903f-8de3-426a-b42c-4110baef32dc None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:51.353089 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66903f-8de3-426a-b42c-4110baef32dc None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:51.353484 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66903f-8de3-426a-b42c-4110baef32dc None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:51.354925 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 534/1031] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:51.360474 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d044bb-2b89-44e3-b33a-242922ad3879 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:51.360978 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d044bb-2b89-44e3-b33a-242922ad3879 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:51.361084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d044bb-2b89-44e3-b33a-242922ad3879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:51.379927 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-95d044bb-2b89-44e3-b33a-242922ad3879 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:51.381138 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-95d044bb-2b89-44e3-b33a-242922ad3879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:51.389883 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 498/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:26:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:26:51.433889 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66903f-8de3-426a-b42c-4110baef32dc None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:51.447920 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66903f-8de3-426a-b42c-4110baef32dc None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:51.452940 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc0d7b-57fd-4962-b05c-a9a8c44889ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:51.453569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc0d7b-57fd-4962-b05c-a9a8c44889ea service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:51.453944 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc0d7b-57fd-4962-b05c-a9a8c44889ea service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:51.454218 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc0d7b-57fd-4962-b05c-a9a8c44889ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:51.462950 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc0d7b-57fd-4962-b05c-a9a8c44889ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:51.464480 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc0d7b-57fd-4962-b05c-a9a8c44889ea service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:51.473888 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 535/1033] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:52.488084 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc29e0-c0a3-4406-ae21-12dfc3e200e6 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:52.488678 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc29e0-c0a3-4406-ae21-12dfc3e200e6 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:52.488678 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc29e0-c0a3-4406-ae21-12dfc3e200e6 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:52.490058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 499/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:52.495395 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e0cea-abfb-41eb-9c2c-5e04ec73c578 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:52.495854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e0cea-abfb-41eb-9c2c-5e04ec73c578 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:52.495991 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e0cea-abfb-41eb-9c2c-5e04ec73c578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:52.515267 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-5a9e0cea-abfb-41eb-9c2c-5e04ec73c578 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:52.516469 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-5a9e0cea-abfb-41eb-9c2c-5e04ec73c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:52.524403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 536/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:26:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:26:52.706766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc29e0-c0a3-4406-ae21-12dfc3e200e6 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:52.720187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc29e0-c0a3-4406-ae21-12dfc3e200e6 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:52.725162 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c45f9-1e67-4f56-bd8f-73fc7a42fcb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:52.725790 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c45f9-1e67-4f56-bd8f-73fc7a42fcb6 service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:52.726073 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c45f9-1e67-4f56-bd8f-73fc7a42fcb6 service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:52.726350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c45f9-1e67-4f56-bd8f-73fc7a42fcb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:52.734442 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c45f9-1e67-4f56-bd8f-73fc7a42fcb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:52.736077 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c45f9-1e67-4f56-bd8f-73fc7a42fcb6 service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:52.746008 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 500/1036] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:53.682577 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2361b2-27a6-4091-9c2f-49c346cd68dd None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:53.683171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2361b2-27a6-4091-9c2f-49c346cd68dd None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:53.683171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2361b2-27a6-4091-9c2f-49c346cd68dd None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:53.684511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 537/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:53.689361 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb984a48-2e34-4b73-bf32-ffb9b257e8bb None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:53.689764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb984a48-2e34-4b73-bf32-ffb9b257e8bb None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:53.689909 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb984a48-2e34-4b73-bf32-ffb9b257e8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:53.708258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-fb984a48-2e34-4b73-bf32-ffb9b257e8bb None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:53.709454 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-fb984a48-2e34-4b73-bf32-ffb9b257e8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:53.717925 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 501/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:26:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:53.872411 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2361b2-27a6-4091-9c2f-49c346cd68dd None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:53.886922 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2361b2-27a6-4091-9c2f-49c346cd68dd None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:53.891626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37739c15-2616-4fbd-b544-c2c9aadffe4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:53.892271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739c15-2616-4fbd-b544-c2c9aadffe4a service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:53.892677 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739c15-2616-4fbd-b544-c2c9aadffe4a service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:53.892958 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739c15-2616-4fbd-b544-c2c9aadffe4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:53.901854 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37739c15-2616-4fbd-b544-c2c9aadffe4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:53.903544 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37739c15-2616-4fbd-b544-c2c9aadffe4a service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:53.913047 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 538/1039] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:54.824048 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad91d8-7616-4f3b-b9ea-0d0763ded2be None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:54.824616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad91d8-7616-4f3b-b9ea-0d0763ded2be None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:54.824616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad91d8-7616-4f3b-b9ea-0d0763ded2be None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:54.825995 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 502/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:54.830958 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10818dfc-ed4d-4438-bea5-c778f8987e16 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:54.831361 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10818dfc-ed4d-4438-bea5-c778f8987e16 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:54.831517 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10818dfc-ed4d-4438-bea5-c778f8987e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:54.849870 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-10818dfc-ed4d-4438-bea5-c778f8987e16 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:54.851126 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-10818dfc-ed4d-4438-bea5-c778f8987e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:54.859739 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 539/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:26:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:55.012716 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad91d8-7616-4f3b-b9ea-0d0763ded2be None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:55.027071 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad91d8-7616-4f3b-b9ea-0d0763ded2be None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:55.033250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e1251-8f76-4518-bbfe-3e91889e12c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:55.033882 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e1251-8f76-4518-bbfe-3e91889e12c2 service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:55.034162 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e1251-8f76-4518-bbfe-3e91889e12c2 service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:55.034435 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e1251-8f76-4518-bbfe-3e91889e12c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:55.043392 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e1251-8f76-4518-bbfe-3e91889e12c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:55.044970 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e1251-8f76-4518-bbfe-3e91889e12c2 service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:55.054196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 503/1042] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:55.971843 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c67b-555c-49ad-89cb-5a759524f634 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:55.972405 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c67b-555c-49ad-89cb-5a759524f634 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:55.972501 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59c67b-555c-49ad-89cb-5a759524f634 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:55.973807 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 540/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:55.979389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240cea5-049e-4a36-8695-3a3fcd3a9e82 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:55.979820 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240cea5-049e-4a36-8695-3a3fcd3a9e82 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:55.979923 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240cea5-049e-4a36-8695-3a3fcd3a9e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:55.998764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-9240cea5-049e-4a36-8695-3a3fcd3a9e82 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:55.999953 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-9240cea5-049e-4a36-8695-3a3fcd3a9e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:56.007849 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 504/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:26:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:56.161380 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59c67b-555c-49ad-89cb-5a759524f634 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:56.174893 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59c67b-555c-49ad-89cb-5a759524f634 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:56.179797 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f7d0d-efaa-4f44-8d3c-8bf7e96b0673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:56.180436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f7d0d-efaa-4f44-8d3c-8bf7e96b0673 service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:56.180745 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f7d0d-efaa-4f44-8d3c-8bf7e96b0673 service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:56.181021 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f7d0d-efaa-4f44-8d3c-8bf7e96b0673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:56.189350 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f7d0d-efaa-4f44-8d3c-8bf7e96b0673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:56.190977 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f7d0d-efaa-4f44-8d3c-8bf7e96b0673 service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:56.200868 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 541/1045] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:57.140676 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fc8a7-99ff-4097-add9-55d27e9bc568 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:57.141316 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fc8a7-99ff-4097-add9-55d27e9bc568 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:57.141316 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fc8a7-99ff-4097-add9-55d27e9bc568 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:57.142664 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 505/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:57.147334 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f43c6-b83c-4924-88e2-203975b47fc5 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:57.147713 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f43c6-b83c-4924-88e2-203975b47fc5 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:57.147900 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f43c6-b83c-4924-88e2-203975b47fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:57.171170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-ee8f43c6-b83c-4924-88e2-203975b47fc5 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:57.172373 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-ee8f43c6-b83c-4924-88e2-203975b47fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:57.180190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 542/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:26:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:26:57.336224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fc8a7-99ff-4097-add9-55d27e9bc568 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:57.350389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fc8a7-99ff-4097-add9-55d27e9bc568 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:57.356383 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747783b-42d4-4a1a-a1b4-93f0085ba7a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:57.357018 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747783b-42d4-4a1a-a1b4-93f0085ba7a3 service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:57.357302 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747783b-42d4-4a1a-a1b4-93f0085ba7a3 service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:57.357581 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747783b-42d4-4a1a-a1b4-93f0085ba7a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:57.365666 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747783b-42d4-4a1a-a1b4-93f0085ba7a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:57.367298 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747783b-42d4-4a1a-a1b4-93f0085ba7a3 service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:57.377143 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 506/1048] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:58.323615 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd126d6-ed68-4c52-9050-b7bd3c3816ee None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:58.324125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd126d6-ed68-4c52-9050-b7bd3c3816ee None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:58.324125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd126d6-ed68-4c52-9050-b7bd3c3816ee None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:58.325447 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 543/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:58.330425 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e170b9-4bcf-4de8-8a9c-76bad914574f None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:58.330878 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e170b9-4bcf-4de8-8a9c-76bad914574f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:58.331020 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e170b9-4bcf-4de8-8a9c-76bad914574f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:58.348618 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-57e170b9-4bcf-4de8-8a9c-76bad914574f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:58.349816 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-57e170b9-4bcf-4de8-8a9c-76bad914574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:58.358155 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 507/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:26:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:58.509365 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd126d6-ed68-4c52-9050-b7bd3c3816ee None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:58.522467 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd126d6-ed68-4c52-9050-b7bd3c3816ee None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:58.528129 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a5321-67a5-414d-9355-81cf7c159676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:58.528756 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a5321-67a5-414d-9355-81cf7c159676 service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:58.529043 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a5321-67a5-414d-9355-81cf7c159676 service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:58.529312 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a5321-67a5-414d-9355-81cf7c159676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:58.537238 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a5321-67a5-414d-9355-81cf7c159676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:58.538847 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a5321-67a5-414d-9355-81cf7c159676 service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:58.548743 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 544/1051] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:26:59.473713 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca621-982a-4f0d-a3f4-9f15a03d2d7f None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:59.474219 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca621-982a-4f0d-a3f4-9f15a03d2d7f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:59.474219 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca621-982a-4f0d-a3f4-9f15a03d2d7f None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:59.475633 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 508/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:26:59.481229 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f98f4-a993-46d6-b385-96774e7c16ab None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:59.481631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f98f4-a993-46d6-b385-96774e7c16ab None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:59.481791 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f98f4-a993-46d6-b385-96774e7c16ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:59.500131 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-464f98f4-a993-46d6-b385-96774e7c16ab None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:26:59.501323 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-464f98f4-a993-46d6-b385-96774e7c16ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:26:59.509837 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 545/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:26:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:26:59.662606 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca621-982a-4f0d-a3f4-9f15a03d2d7f None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:26:59.676957 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca621-982a-4f0d-a3f4-9f15a03d2d7f None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:26:59.682327 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675065da-7200-4d0d-b939-77f0aa3342cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:26:59.682984 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675065da-7200-4d0d-b939-77f0aa3342cc service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:26:59.683269 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675065da-7200-4d0d-b939-77f0aa3342cc service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:26:59.683549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675065da-7200-4d0d-b939-77f0aa3342cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:26:59.691827 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675065da-7200-4d0d-b939-77f0aa3342cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:26:59.693422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675065da-7200-4d0d-b939-77f0aa3342cc service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:26:59.703499 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 509/1054] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:26:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:00.637971 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62b7f-79e0-4d21-a99d-55b3a9bf4ecb None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:00.638575 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62b7f-79e0-4d21-a99d-55b3a9bf4ecb None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:00.638575 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62b7f-79e0-4d21-a99d-55b3a9bf4ecb None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:00.639943 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 546/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:00.644774 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f681445-9033-4f3f-9f9e-dfe07e28460f None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:00.645223 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f681445-9033-4f3f-9f9e-dfe07e28460f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:00.645330 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f681445-9033-4f3f-9f9e-dfe07e28460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:00.663153 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-6f681445-9033-4f3f-9f9e-dfe07e28460f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:00.664350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-6f681445-9033-4f3f-9f9e-dfe07e28460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:00.672670 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 510/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:27:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:00.824600 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d62b7f-79e0-4d21-a99d-55b3a9bf4ecb None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:00.838350 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d62b7f-79e0-4d21-a99d-55b3a9bf4ecb None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:00.843631 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2be45f-3d56-4a90-99d7-e4e6cf0033a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:00.844267 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2be45f-3d56-4a90-99d7-e4e6cf0033a9 service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:00.844554 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2be45f-3d56-4a90-99d7-e4e6cf0033a9 service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:00.844833 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2be45f-3d56-4a90-99d7-e4e6cf0033a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:00.854249 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2be45f-3d56-4a90-99d7-e4e6cf0033a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:00.855888 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2be45f-3d56-4a90-99d7-e4e6cf0033a9 service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:00.865161 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 547/1057] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:03.027540 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd976ff-abdb-4025-9dd6-443cd58acce4 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:03.028110 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd976ff-abdb-4025-9dd6-443cd58acce4 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:03.028110 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd976ff-abdb-4025-9dd6-443cd58acce4 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:03.029493 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 511/1058] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:03.034660 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d301033-cffe-498c-92f6-fa3c6cf50f6a None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:03.035053 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d301033-cffe-498c-92f6-fa3c6cf50f6a None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:03.035245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d301033-cffe-498c-92f6-fa3c6cf50f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:03.053113 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-6d301033-cffe-498c-92f6-fa3c6cf50f6a None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:03.054339 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-6d301033-cffe-498c-92f6-fa3c6cf50f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:03.063171 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 548/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:27:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:03.102083 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd976ff-abdb-4025-9dd6-443cd58acce4 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:03.113267 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd976ff-abdb-4025-9dd6-443cd58acce4 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:03.116952 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5431e6-12f0-41d1-9463-137103ce157b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:03.117587 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5431e6-12f0-41d1-9463-137103ce157b service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:03.118411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5431e6-12f0-41d1-9463-137103ce157b service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:03.118843 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5431e6-12f0-41d1-9463-137103ce157b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:03.129873 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5431e6-12f0-41d1-9463-137103ce157b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:03.131371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5431e6-12f0-41d1-9463-137103ce157b service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:03.141551 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 512/1060] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:27:05.656494 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393402-f96e-4df7-b79a-ce2beeedb569 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:05.657061 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393402-f96e-4df7-b79a-ce2beeedb569 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:05.657061 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393402-f96e-4df7-b79a-ce2beeedb569 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:05.658416 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 549/1061] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:05.663856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560f1fd-4184-4e10-9280-867babf10f71 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:05.664241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560f1fd-4184-4e10-9280-867babf10f71 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:05.669468 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560f1fd-4184-4e10-9280-867babf10f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:05.682968 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-e560f1fd-4184-4e10-9280-867babf10f71 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:05.684173 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-e560f1fd-4184-4e10-9280-867babf10f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:05.691886 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 513/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:27:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:05.732965 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393402-f96e-4df7-b79a-ce2beeedb569 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:05.743698 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393402-f96e-4df7-b79a-ce2beeedb569 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:05.747322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132ba05-7e21-4559-9451-c493bc8a4e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:05.747952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132ba05-7e21-4559-9451-c493bc8a4e3e service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:05.748236 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132ba05-7e21-4559-9451-c493bc8a4e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:05.748511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132ba05-7e21-4559-9451-c493bc8a4e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:05.757736 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132ba05-7e21-4559-9451-c493bc8a4e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:05.759702 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132ba05-7e21-4559-9451-c493bc8a4e3e service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:05.769065 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 550/1063] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:08.520610 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034f4e0-8785-4366-8f71-940a469dc403 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:08.521178 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034f4e0-8785-4366-8f71-940a469dc403 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:08.521178 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034f4e0-8785-4366-8f71-940a469dc403 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:08.522583 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 514/1064] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:08.528666 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979729a-45d2-4499-81ce-d30c20c3c315 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:08.529080 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979729a-45d2-4499-81ce-d30c20c3c315 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:08.529218 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979729a-45d2-4499-81ce-d30c20c3c315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:08.547374 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-1979729a-45d2-4499-81ce-d30c20c3c315 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:08.548558 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-1979729a-45d2-4499-81ce-d30c20c3c315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:08.556466 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 551/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:27:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:27:08.595333 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034f4e0-8785-4366-8f71-940a469dc403 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:08.605956 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034f4e0-8785-4366-8f71-940a469dc403 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:08.609433 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac0312-6483-42f3-95eb-bd2215f0e505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:08.610058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac0312-6483-42f3-95eb-bd2215f0e505 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:08.610339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac0312-6483-42f3-95eb-bd2215f0e505 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:08.610613 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac0312-6483-42f3-95eb-bd2215f0e505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:08.619871 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac0312-6483-42f3-95eb-bd2215f0e505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:08.621285 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac0312-6483-42f3-95eb-bd2215f0e505 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:08.630737 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 515/1066] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:11.060469 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7be71-3326-4f36-b420-8f9bdb610502 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:11.061004 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7be71-3326-4f36-b420-8f9bdb610502 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:11.061004 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7be71-3326-4f36-b420-8f9bdb610502 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:11.062423 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 552/1067] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:11.067628 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2cfb2-5fa9-4ecf-96b6-898c3e38233f None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:11.068073 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2cfb2-5fa9-4ecf-96b6-898c3e38233f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:11.068172 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2cfb2-5fa9-4ecf-96b6-898c3e38233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:11.086215 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-d4a2cfb2-5fa9-4ecf-96b6-898c3e38233f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:11.088172 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-d4a2cfb2-5fa9-4ecf-96b6-898c3e38233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:11.095843 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 516/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:27:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:11.134574 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7be71-3326-4f36-b420-8f9bdb610502 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:11.145353 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7be71-3326-4f36-b420-8f9bdb610502 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:11.148856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c1e5c-66b8-4465-b848-1c5b1a2a9021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:11.150072 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1e5c-66b8-4465-b848-1c5b1a2a9021 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:11.150354 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1e5c-66b8-4465-b848-1c5b1a2a9021 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:11.150625 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1e5c-66b8-4465-b848-1c5b1a2a9021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:11.159639 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c1e5c-66b8-4465-b848-1c5b1a2a9021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:11.161072 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c1e5c-66b8-4465-b848-1c5b1a2a9021 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:11.170270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 553/1069] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:13.546597 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e17fc-cb42-466f-8887-96c7b6aa61ca None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:13.547151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e17fc-cb42-466f-8887-96c7b6aa61ca None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:13.547151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e17fc-cb42-466f-8887-96c7b6aa61ca None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:13.548518 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 517/1070] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:13.553695 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525f610-0908-4249-b790-b885c1fb7e24 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:13.554112 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525f610-0908-4249-b790-b885c1fb7e24 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:13.554253 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525f610-0908-4249-b790-b885c1fb7e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:13.572909 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-a525f610-0908-4249-b790-b885c1fb7e24 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:13.574083 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-a525f610-0908-4249-b790-b885c1fb7e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:13.581743 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 554/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:27:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:13.620413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e17fc-cb42-466f-8887-96c7b6aa61ca None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:13.631244 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e17fc-cb42-466f-8887-96c7b6aa61ca None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:13.635590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06d6aa-1ed2-426e-a089-e1bd0f9b0065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:13.636223 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06d6aa-1ed2-426e-a089-e1bd0f9b0065 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:13.636507 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06d6aa-1ed2-426e-a089-e1bd0f9b0065 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:13.636784 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06d6aa-1ed2-426e-a089-e1bd0f9b0065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:13.645702 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06d6aa-1ed2-426e-a089-e1bd0f9b0065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:13.647180 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06d6aa-1ed2-426e-a089-e1bd0f9b0065 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:13.656819 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 518/1072] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:16.062316 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99559fd-0975-42f5-b0ee-723738501503 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:16.062904 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99559fd-0975-42f5-b0ee-723738501503 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:16.062904 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99559fd-0975-42f5-b0ee-723738501503 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:16.064262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 555/1073] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:16.069529 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c76323-4287-41a7-b2c9-d73311043af4 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:16.069955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c76323-4287-41a7-b2c9-d73311043af4 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:16.070086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c76323-4287-41a7-b2c9-d73311043af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:16.076485 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=75 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:27:16.089139 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-b1c76323-4287-41a7-b2c9-d73311043af4 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:16.090355 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-b1c76323-4287-41a7-b2c9-d73311043af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:16.098959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 519/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:27:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:27:16.139279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99559fd-0975-42f5-b0ee-723738501503 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:16.144668 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=64 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:27:16.150945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99559fd-0975-42f5-b0ee-723738501503 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:16.154447 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354b075-514a-410a-b7c4-ff1bd3a8c861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:16.155112 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354b075-514a-410a-b7c4-ff1bd3a8c861 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:16.155399 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354b075-514a-410a-b7c4-ff1bd3a8c861 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:16.155678 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354b075-514a-410a-b7c4-ff1bd3a8c861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:16.165554 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354b075-514a-410a-b7c4-ff1bd3a8c861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:16.167032 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354b075-514a-410a-b7c4-ff1bd3a8c861 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:16.177233 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 556/1075] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:18.537994 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2158db-4af3-4fd8-b372-2b5608fe7add None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:18.538561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2158db-4af3-4fd8-b372-2b5608fe7add None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:18.538561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2158db-4af3-4fd8-b372-2b5608fe7add None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:18.540063 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 520/1076] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:18.545538 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694d9d1-3fa5-4e78-b64a-be544089bc28 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:18.545933 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694d9d1-3fa5-4e78-b64a-be544089bc28 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:18.546087 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694d9d1-3fa5-4e78-b64a-be544089bc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:18.563838 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-8694d9d1-3fa5-4e78-b64a-be544089bc28 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:18.565022 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-8694d9d1-3fa5-4e78-b64a-be544089bc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:18.573525 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 557/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:27:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:18.612150 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2158db-4af3-4fd8-b372-2b5608fe7add None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:18.622890 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2158db-4af3-4fd8-b372-2b5608fe7add None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:18.626400 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8462-ab04-425c-bd53-f6eb58925fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:18.627100 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8462-ab04-425c-bd53-f6eb58925fea service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:18.627387 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8462-ab04-425c-bd53-f6eb58925fea service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:18.627667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8462-ab04-425c-bd53-f6eb58925fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:18.637611 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e8462-ab04-425c-bd53-f6eb58925fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:18.639090 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e8462-ab04-425c-bd53-f6eb58925fea service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:18.648385 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 521/1078] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:21.002579 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d87842-67cc-467b-b815-d6a9dbf671f1 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:21.003187 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d87842-67cc-467b-b815-d6a9dbf671f1 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:21.003187 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d87842-67cc-467b-b815-d6a9dbf671f1 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:21.004796 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 558/1079] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:21.011011 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a20129-d4ab-48ff-af03-d73a94041dbb None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:21.011424 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a20129-d4ab-48ff-af03-d73a94041dbb None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:21.011569 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a20129-d4ab-48ff-af03-d73a94041dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:21.029597 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-64a20129-d4ab-48ff-af03-d73a94041dbb None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:21.030845 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-64a20129-d4ab-48ff-af03-d73a94041dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:21.038649 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 522/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:27:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:21.078737 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d87842-67cc-467b-b815-d6a9dbf671f1 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:21.090108 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d87842-67cc-467b-b815-d6a9dbf671f1 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:21.093573 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df68d7-7fe2-4b78-bc5c-c965a786a84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:21.094201 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df68d7-7fe2-4b78-bc5c-c965a786a84a service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:21.094485 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df68d7-7fe2-4b78-bc5c-c965a786a84a service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:21.094796 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df68d7-7fe2-4b78-bc5c-c965a786a84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:21.104251 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df68d7-7fe2-4b78-bc5c-c965a786a84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:21.105684 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df68d7-7fe2-4b78-bc5c-c965a786a84a service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:21.114965 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 559/1081] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:23.434983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0400819-cc6e-46f3-868b-2ae9a77b61fe None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:23.435514 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0400819-cc6e-46f3-868b-2ae9a77b61fe None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:23.435633 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0400819-cc6e-46f3-868b-2ae9a77b61fe None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:23.436954 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 523/1082] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:23.442229 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ef753-8fdb-4072-9f5a-00189767938a None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:23.442708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ef753-8fdb-4072-9f5a-00189767938a None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:23.442851 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ef753-8fdb-4072-9f5a-00189767938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:23.460297 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-f40ef753-8fdb-4072-9f5a-00189767938a None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:23.462093 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-f40ef753-8fdb-4072-9f5a-00189767938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:23.469849 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 560/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:27:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:23.507914 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0400819-cc6e-46f3-868b-2ae9a77b61fe None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:23.518504 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0400819-cc6e-46f3-868b-2ae9a77b61fe None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:23.521974 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e60d7a-12a5-4815-97d2-9f7355609861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:23.522607 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60d7a-12a5-4815-97d2-9f7355609861 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:23.522925 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60d7a-12a5-4815-97d2-9f7355609861 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:23.523205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60d7a-12a5-4815-97d2-9f7355609861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:23.532641 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e60d7a-12a5-4815-97d2-9f7355609861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:23.534065 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e60d7a-12a5-4815-97d2-9f7355609861 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:23.544313 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 524/1084] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:25.856074 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36459851-918f-46a6-9adc-40812e6bfaf4 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:25.856598 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36459851-918f-46a6-9adc-40812e6bfaf4 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:25.856717 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36459851-918f-46a6-9adc-40812e6bfaf4 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:25.858008 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 561/1085] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:25.863410 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8975aef-12a5-4706-93bd-6220ff594d8f None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:25.863811 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8975aef-12a5-4706-93bd-6220ff594d8f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:25.864043 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8975aef-12a5-4706-93bd-6220ff594d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:25.881955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-a8975aef-12a5-4706-93bd-6220ff594d8f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:25.883256 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-a8975aef-12a5-4706-93bd-6220ff594d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:25.891296 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 525/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:27:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:25.928902 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36459851-918f-46a6-9adc-40812e6bfaf4 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:25.939681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36459851-918f-46a6-9adc-40812e6bfaf4 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:25.943223 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83605e-83ae-4812-a939-1b6801d8acb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:25.943856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83605e-83ae-4812-a939-1b6801d8acb1 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:25.944141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83605e-83ae-4812-a939-1b6801d8acb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:25.944418 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83605e-83ae-4812-a939-1b6801d8acb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:25.953955 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83605e-83ae-4812-a939-1b6801d8acb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:25.955416 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83605e-83ae-4812-a939-1b6801d8acb1 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:25.965444 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 562/1087] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:27:35.876420 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=20 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:27:35.961254 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=23 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:27:59.266362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd1ab3-fa0e-42c2-9d0b-3c640a1e56db None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:59.266885 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd1ab3-fa0e-42c2-9d0b-3c640a1e56db None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:59.266993 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd1ab3-fa0e-42c2-9d0b-3c640a1e56db None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:59.268320 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 526/1088] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:59.274116 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ecdc0-09da-49ca-b03d-6c01644c675f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:59.274552 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ecdc0-09da-49ca-b03d-6c01644c675f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:59.274702 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ecdc0-09da-49ca-b03d-6c01644c675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:59.292075 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-186ecdc0-09da-49ca-b03d-6c01644c675f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:59.293260 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-186ecdc0-09da-49ca-b03d-6c01644c675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:59.301099 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 563/1089] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:27:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:59.351093 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2445a6-fed9-43d3-984d-01a4f4cc2637 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:59.351393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2445a6-fed9-43d3-984d-01a4f4cc2637 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:59.351682 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2445a6-fed9-43d3-984d-01a4f4cc2637 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:59.353052 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 527/1090] 10.222.0.59 () {54 vars in 962 bytes} [Thu Jun 2 14:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:27:59.358333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a4ee-1685-41bc-b031-9c642d5f240e None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:59.358623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a4ee-1685-41bc-b031-9c642d5f240e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:59.358940 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a4ee-1685-41bc-b031-9c642d5f240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:59.377211 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-82b6a4ee-1685-41bc-b031-9c642d5f240e None None] MFA Rules not processed for user `45eae0d918d5451dab9283e2826ffdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:27:59.378384 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-82b6a4ee-1685-41bc-b031-9c642d5f240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:27:59.385604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 564/1091] 10.222.0.59 () {58 vars in 1059 bytes} [Thu Jun 2 14:27:59 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:27:59.392642 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2445a6-fed9-43d3-984d-01a4f4cc2637 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:27:59.403553 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2445a6-fed9-43d3-984d-01a4f4cc2637 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:27:59.407116 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0101df-b760-47a8-bfbf-254afccf5ce8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45eae0d918d5451dab9283e2826ffdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:27:59.407780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0101df-b760-47a8-bfbf-254afccf5ce8 service glance] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:27:59.408063 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0101df-b760-47a8-bfbf-254afccf5ce8 service glance] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:27:59.408341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0101df-b760-47a8-bfbf-254afccf5ce8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:27:59.417693 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0101df-b760-47a8-bfbf-254afccf5ce8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:27:59.419169 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0101df-b760-47a8-bfbf-254afccf5ce8 service glance] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:27:59.429237 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 528/1092] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:27:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:28:01.830671 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dfc3c-199d-4acc-a162-f33bb41ad747 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:01.831243 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dfc3c-199d-4acc-a162-f33bb41ad747 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:01.831243 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dfc3c-199d-4acc-a162-f33bb41ad747 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:01.832580 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 565/1093] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:28:01.838304 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3cd07-0b6d-4ad4-90ce-58484f65943c None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:01.838775 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3cd07-0b6d-4ad4-90ce-58484f65943c None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:01.838912 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3cd07-0b6d-4ad4-90ce-58484f65943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:01.857427 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-bad3cd07-0b6d-4ad4-90ce-58484f65943c None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:28:01.858633 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-bad3cd07-0b6d-4ad4-90ce-58484f65943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:28:01.866803 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 529/1094] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:28:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:28:01.892283 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dfc3c-199d-4acc-a162-f33bb41ad747 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:28:01.905072 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dfc3c-199d-4acc-a162-f33bb41ad747 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:28:01.909434 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212c099-5254-44c3-929f-02d4ba15f243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:28:01.910064 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c099-5254-44c3-929f-02d4ba15f243 admin admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:01.910347 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c099-5254-44c3-929f-02d4ba15f243 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:01.910623 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c099-5254-44c3-929f-02d4ba15f243 admin admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:01.911369 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212c099-5254-44c3-929f-02d4ba15f243 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:28:01.913829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: WARNING py.warnings [None req-f212c099-5254-44c3-929f-02d4ba15f243 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:28:01.913829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: warnings.warn(msg) Jun 02 14:28:01.913829 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: Jun 02 14:28:01.915025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212c099-5254-44c3-929f-02d4ba15f243 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:28:01.932927 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 566/1095] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Jun 2 14:28:01 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:28:04.229530 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9042-34c0-465c-9823-743d69a24474 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:04.230039 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9042-34c0-465c-9823-743d69a24474 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:04.230039 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9042-34c0-465c-9823-743d69a24474 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:04.231402 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 530/1096] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:28:04.236648 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851dc9-edb5-407a-8715-953849a5db36 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:04.239512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851dc9-edb5-407a-8715-953849a5db36 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:04.239512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851dc9-edb5-407a-8715-953849a5db36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:04.255433 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-ab851dc9-edb5-407a-8715-953849a5db36 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:28:04.257392 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-ab851dc9-edb5-407a-8715-953849a5db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:28:04.265290 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 567/1097] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:28:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:28:04.308884 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9042-34c0-465c-9823-743d69a24474 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:28:04.323315 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9042-34c0-465c-9823-743d69a24474 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:28:04.328281 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7327c-f837-4d84-aa1b-871038e4846b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:28:04.328915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7327c-f837-4d84-aa1b-871038e4846b service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:04.333049 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7327c-f837-4d84-aa1b-871038e4846b service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:04.333049 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7327c-f837-4d84-aa1b-871038e4846b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:04.338453 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7327c-f837-4d84-aa1b-871038e4846b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:28:04.340061 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7327c-f837-4d84-aa1b-871038e4846b service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:28:04.349641 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 531/1098] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:28:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:28:06.846008 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8cc4-3f55-4988-aae2-9e32fcca1d16 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:06.846572 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8cc4-3f55-4988-aae2-9e32fcca1d16 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:06.846572 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8cc4-3f55-4988-aae2-9e32fcca1d16 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:06.847989 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 568/1099] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:28:06.853925 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba06f07-882f-4831-a5fd-88fe93fa6e9e None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:06.854351 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba06f07-882f-4831-a5fd-88fe93fa6e9e None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:06.854481 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba06f07-882f-4831-a5fd-88fe93fa6e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:06.872408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-3ba06f07-882f-4831-a5fd-88fe93fa6e9e None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:28:06.873712 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-3ba06f07-882f-4831-a5fd-88fe93fa6e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:28:06.882452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 532/1100] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:28:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:28:06.920871 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8cc4-3f55-4988-aae2-9e32fcca1d16 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:28:06.932039 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8cc4-3f55-4988-aae2-9e32fcca1d16 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:28:06.935596 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b089758-ffbb-4a52-8069-8916d4ce0e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:28:06.936225 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b089758-ffbb-4a52-8069-8916d4ce0e5e service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:06.936506 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b089758-ffbb-4a52-8069-8916d4ce0e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:06.936784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b089758-ffbb-4a52-8069-8916d4ce0e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:06.945678 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b089758-ffbb-4a52-8069-8916d4ce0e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:28:06.947178 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b089758-ffbb-4a52-8069-8916d4ce0e5e service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:28:06.956302 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 569/1101] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:28:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:28:09.308397 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696ade-b702-468b-a95f-524f31be16d0 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:09.308930 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696ade-b702-468b-a95f-524f31be16d0 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:09.309078 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696ade-b702-468b-a95f-524f31be16d0 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:09.310362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 533/1102] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:28:09.315710 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750426b-95e5-4097-8eb5-3bd57863ae00 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:09.316137 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750426b-95e5-4097-8eb5-3bd57863ae00 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:09.316270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750426b-95e5-4097-8eb5-3bd57863ae00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:09.334614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-d750426b-95e5-4097-8eb5-3bd57863ae00 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:28:09.335813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-d750426b-95e5-4097-8eb5-3bd57863ae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:28:09.343553 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 570/1103] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:28:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:28:09.383160 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b696ade-b702-468b-a95f-524f31be16d0 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:28:09.393781 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b696ade-b702-468b-a95f-524f31be16d0 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:28:09.397306 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58f80a-78a2-43b8-a30a-c27ce73eddd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:28:09.397927 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58f80a-78a2-43b8-a30a-c27ce73eddd1 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:09.398207 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58f80a-78a2-43b8-a30a-c27ce73eddd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:09.398482 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58f80a-78a2-43b8-a30a-c27ce73eddd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:09.407237 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58f80a-78a2-43b8-a30a-c27ce73eddd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:28:09.408655 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58f80a-78a2-43b8-a30a-c27ce73eddd1 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:28:09.418513 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 534/1104] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:28:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:28:11.929449 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c79ca7-c7e8-4b54-97e4-07c06c7ac274 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:11.930007 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c79ca7-c7e8-4b54-97e4-07c06c7ac274 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:11.930007 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c79ca7-c7e8-4b54-97e4-07c06c7ac274 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:11.931388 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 571/1105] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:28:11.936760 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86148af4-7c2d-4f7a-a45f-31e878144c3a None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:11.937187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86148af4-7c2d-4f7a-a45f-31e878144c3a None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:11.937325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86148af4-7c2d-4f7a-a45f-31e878144c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:11.955615 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-86148af4-7c2d-4f7a-a45f-31e878144c3a None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:28:11.961523 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-86148af4-7c2d-4f7a-a45f-31e878144c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:28:11.965120 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 535/1106] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:28:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:28:12.007152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c79ca7-c7e8-4b54-97e4-07c06c7ac274 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:28:12.018363 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c79ca7-c7e8-4b54-97e4-07c06c7ac274 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:28:12.022423 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2691cfa-a691-4ac6-9fcb-b67de6b87a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:28:12.023098 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691cfa-a691-4ac6-9fcb-b67de6b87a94 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:12.023383 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691cfa-a691-4ac6-9fcb-b67de6b87a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:12.023656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691cfa-a691-4ac6-9fcb-b67de6b87a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:12.032694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2691cfa-a691-4ac6-9fcb-b67de6b87a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:28:12.034135 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2691cfa-a691-4ac6-9fcb-b67de6b87a94 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:28:12.044257 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 572/1107] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:28:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:28:14.699631 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c9c9-2159-4aae-a53e-19d3954e8b3a None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:14.700175 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c9c9-2159-4aae-a53e-19d3954e8b3a None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:14.700175 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c9c9-2159-4aae-a53e-19d3954e8b3a None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:14.701549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 536/1108] 10.222.0.59 () {54 vars in 926 bytes} [Thu Jun 2 14:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:28:14.706717 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393b09-3326-463c-a2ee-811a7f7b1394 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:14.707140 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393b09-3326-463c-a2ee-811a7f7b1394 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:14.707299 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393b09-3326-463c-a2ee-811a7f7b1394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:14.726502 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-4e393b09-3326-463c-a2ee-811a7f7b1394 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:28:14.727722 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-4e393b09-3326-463c-a2ee-811a7f7b1394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:28:14.735455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 573/1109] 10.222.0.59 () {58 vars in 1023 bytes} [Thu Jun 2 14:28:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:28:14.775930 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4c9c9-2159-4aae-a53e-19d3954e8b3a None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:28:14.786595 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4c9c9-2159-4aae-a53e-19d3954e8b3a None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:28:14.790202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30653c2-f21e-481d-8d70-a573a33e1084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:28:14.790857 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30653c2-f21e-481d-8d70-a573a33e1084 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:28:14.791138 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30653c2-f21e-481d-8d70-a573a33e1084 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:28:14.791409 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30653c2-f21e-481d-8d70-a573a33e1084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:28:14.800569 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30653c2-f21e-481d-8d70-a573a33e1084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:28:14.801986 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30653c2-f21e-481d-8d70-a573a33e1084 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:28:14.811678 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 537/1110] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:28:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:28:24.720657 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=33 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:28:24.807527 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=33 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:29:50.610581 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175439-0558-491c-ba20-e5505a89120e None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:50.611228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175439-0558-491c-ba20-e5505a89120e None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:50.611228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e175439-0558-491c-ba20-e5505a89120e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:50.630779 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-6e175439-0558-491c-ba20-e5505a89120e None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:29:50.631993 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-6e175439-0558-491c-ba20-e5505a89120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:29:50.639944 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 574/1111] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:29:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:29:50.647783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947dfd7-2db6-484d-b4bc-cb034a43c41f None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:50.648302 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947dfd7-2db6-484d-b4bc-cb034a43c41f None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:50.648406 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947dfd7-2db6-484d-b4bc-cb034a43c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:50.666762 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-0947dfd7-2db6-484d-b4bc-cb034a43c41f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:29:50.667955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-0947dfd7-2db6-484d-b4bc-cb034a43c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:29:50.676004 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 538/1112] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:29:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:29:50.680403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175439-0558-491c-ba20-e5505a89120e None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:29:50.690633 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e175439-0558-491c-ba20-e5505a89120e None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:29:50.695194 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256c1a1-4373-4552-99ae-02786e68f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:29:50.695844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256c1a1-4373-4552-99ae-02786e68f09c admin admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:50.696134 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256c1a1-4373-4552-99ae-02786e68f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:50.696411 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256c1a1-4373-4552-99ae-02786e68f09c admin admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:50.697136 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256c1a1-4373-4552-99ae-02786e68f09c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:29:50.697441 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256c1a1-4373-4552-99ae-02786e68f09c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:29:50.698455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: WARNING py.warnings [None req-9256c1a1-4373-4552-99ae-02786e68f09c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:29:50.698455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: warnings.warn(msg) Jun 02 14:29:50.698455 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: Jun 02 14:29:50.699372 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256c1a1-4373-4552-99ae-02786e68f09c admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:29:50.711438 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 575/1113] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 14:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:29:50.719312 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947dfd7-2db6-484d-b4bc-cb034a43c41f None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:29:50.728384 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947dfd7-2db6-484d-b4bc-cb034a43c41f None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:29:50.732983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfb9af-02cf-4058-bdf3-637414349ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:29:50.733626 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfb9af-02cf-4058-bdf3-637414349ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:50.733909 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfb9af-02cf-4058-bdf3-637414349ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:50.734187 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfb9af-02cf-4058-bdf3-637414349ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:50.734900 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfb9af-02cf-4058-bdf3-637414349ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:29:50.736657 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: WARNING py.warnings [None req-37dfb9af-02cf-4058-bdf3-637414349ce6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:29:50.736657 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: warnings.warn(msg) Jun 02 14:29:50.736657 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: Jun 02 14:29:50.737931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfb9af-02cf-4058-bdf3-637414349ce6 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:29:50.839978 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 539/1114] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 14:29:50 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:29:50.844212 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256c1a1-4373-4552-99ae-02786e68f09c admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:29:50.854093 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256c1a1-4373-4552-99ae-02786e68f09c admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:29:50.909996 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f25566-b775-4e6b-95a0-8fb9c3162b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:29:50.910686 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f25566-b775-4e6b-95a0-8fb9c3162b39 admin admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:50.910972 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f25566-b775-4e6b-95a0-8fb9c3162b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:50.911245 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f25566-b775-4e6b-95a0-8fb9c3162b39 admin admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:50.911922 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f25566-b775-4e6b-95a0-8fb9c3162b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:29:50.912929 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: WARNING py.warnings [None req-f6f25566-b775-4e6b-95a0-8fb9c3162b39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:29:50.912929 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: warnings.warn(msg) Jun 02 14:29:50.912929 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: Jun 02 14:29:50.914124 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f25566-b775-4e6b-95a0-8fb9c3162b39 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:29:50.986793 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 576/1115] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 14:29:50 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:29:50.991090 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfb9af-02cf-4058-bdf3-637414349ce6 admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:29:51.001256 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfb9af-02cf-4058-bdf3-637414349ce6 admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:29:51.006788 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d605e-5449-419c-8fc4-ef855d314db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:29:51.007449 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d605e-5449-419c-8fc4-ef855d314db1 admin admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.007732 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d605e-5449-419c-8fc4-ef855d314db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.008009 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d605e-5449-419c-8fc4-ef855d314db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:51.008736 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d605e-5449-419c-8fc4-ef855d314db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:29:51.009749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: WARNING py.warnings [None req-431d605e-5449-419c-8fc4-ef855d314db1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:29:51.009749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: warnings.warn(msg) Jun 02 14:29:51.009749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: Jun 02 14:29:51.010673 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d605e-5449-419c-8fc4-ef855d314db1 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:29:51.024441 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 540/1116] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 14:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:29:51.028314 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f25566-b775-4e6b-95a0-8fb9c3162b39 admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:29:51.038803 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f25566-b775-4e6b-95a0-8fb9c3162b39 admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:29:51.043497 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923d04f-8319-49d2-839b-d0ac430109c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:29:51.044280 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923d04f-8319-49d2-839b-d0ac430109c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.044571 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923d04f-8319-49d2-839b-d0ac430109c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.044850 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923d04f-8319-49d2-839b-d0ac430109c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:51.045581 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923d04f-8319-49d2-839b-d0ac430109c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:29:51.046590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: WARNING py.warnings [None req-d923d04f-8319-49d2-839b-d0ac430109c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:29:51.046590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: warnings.warn(msg) Jun 02 14:29:51.046590 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: Jun 02 14:29:51.047510 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923d04f-8319-49d2-839b-d0ac430109c6 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:29:51.061389 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 577/1117] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 14:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:29:51.066473 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d605e-5449-419c-8fc4-ef855d314db1 admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:29:51.076496 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d605e-5449-419c-8fc4-ef855d314db1 admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:29:51.081292 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed29049-eda2-4be6-a2af-61fd64367fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:29:51.082165 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed29049-eda2-4be6-a2af-61fd64367fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.082452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed29049-eda2-4be6-a2af-61fd64367fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.082766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed29049-eda2-4be6-a2af-61fd64367fa1 admin admin] PATH_INFO: `/v3/projects/bb32d2e0befd459ba2e604e93bf4d178/users/3577467b06e847b997e004411c459d6a/roles/3ce491f94839419ea9ba3b84324fcd8f` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:51.097413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed29049-eda2-4be6-a2af-61fd64367fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb32d2e0befd459ba2e604e93bf4d178, user_id=3577467b06e847b997e004411c459d6a, role_id=3ce491f94839419ea9ba3b84324fcd8f)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:29:51.098589 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: WARNING py.warnings [None req-eed29049-eda2-4be6-a2af-61fd64367fa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:29:51.098589 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: warnings.warn(msg) Jun 02 14:29:51.098589 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: Jun 02 14:29:51.100549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed29049-eda2-4be6-a2af-61fd64367fa1 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:29:51.169304 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 541/1118] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 14:29:51 2022] PUT /identity/v3/projects/bb32d2e0befd459ba2e604e93bf4d178/users/3577467b06e847b997e004411c459d6a/roles/3ce491f94839419ea9ba3b84324fcd8f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:29:51.184310 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f0312-8893-4e76-b248-0202557468b0 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.184604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f0312-8893-4e76-b248-0202557468b0 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.184885 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f0312-8893-4e76-b248-0202557468b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:51.211738 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-7f0f0312-8893-4e76-b248-0202557468b0 None None] MFA Rules not processed for user `3577467b06e847b997e004411c459d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:29:51.212958 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-7f0f0312-8893-4e76-b248-0202557468b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:29:51.276497 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 578/1119] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:29:51 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:29:51.289987 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45a6c-b668-4d61-a0f1-5599ab081195 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.290277 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45a6c-b668-4d61-a0f1-5599ab081195 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.290557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45a6c-b668-4d61-a0f1-5599ab081195 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:51.291981 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 542/1120] 10.222.0.59 () {54 vars in 963 bytes} [Thu Jun 2 14:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:29:51.296643 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49295ab1-17ba-4687-841b-d9b0c98422aa None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.296984 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49295ab1-17ba-4687-841b-d9b0c98422aa None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.297271 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49295ab1-17ba-4687-841b-d9b0c98422aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:51.327482 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-49295ab1-17ba-4687-841b-d9b0c98422aa None None] MFA Rules not processed for user `b1518eb388a24af9b85e968802e70237`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:29:51.328686 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-49295ab1-17ba-4687-841b-d9b0c98422aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:29:51.360037 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:29:51.380377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 579/1121] 10.222.0.59 () {58 vars in 1060 bytes} [Thu Jun 2 14:29:51 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:29:51.387772 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca45a6c-b668-4d61-a0f1-5599ab081195 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:29:51.398336 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca45a6c-b668-4d61-a0f1-5599ab081195 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:29:51.401876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbe411-04d1-4adc-bcc5-9522ec3d820f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1518eb388a24af9b85e968802e70237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:29:51.402511 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbe411-04d1-4adc-bcc5-9522ec3d820f service cinder] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.402825 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbe411-04d1-4adc-bcc5-9522ec3d820f service cinder] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.403105 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbe411-04d1-4adc-bcc5-9522ec3d820f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:51.411934 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbe411-04d1-4adc-bcc5-9522ec3d820f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:29:51.413370 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbe411-04d1-4adc-bcc5-9522ec3d820f service cinder] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:29:51.422182 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 543/1122] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:29:51 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:29:51.462269 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af181-9fc4-4989-8963-3228bdc253f4 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.462568 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af181-9fc4-4989-8963-3228bdc253f4 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.462896 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af181-9fc4-4989-8963-3228bdc253f4 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:51.464177 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 580/1123] 10.222.0.59 () {52 vars in 829 bytes} [Thu Jun 2 14:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:29:51.467644 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbe411-04d1-4adc-bcc5-9522ec3d820f service cinder] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:29:51.528759 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbe411-04d1-4adc-bcc5-9522ec3d820f service cinder] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:29:51.533371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:29:51.534913 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.535195 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.535468 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] PATH_INFO: `/v3/users/3577467b06e847b997e004411c459d6a` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:51.536668 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3577467b06e847b997e004411c459d6a)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:29:51.537688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: WARNING py.warnings [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:29:51.537688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: warnings.warn(msg) Jun 02 14:29:51.537688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: Jun 02 14:29:51.538915 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:29:51.685394 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3577467b06e847b997e004411c459d6a'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:29:51.703671 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3577467b06e847b997e004411c459d6a'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:29:51.804492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3577467b06e847b997e004411c459d6a'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:29:51.813302 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:29:51.817675 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3577467b06e847b997e004411c459d6a'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:29:51.818335 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3577467b06e847b997e004411c459d6a'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:29:51.824211 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 544/1124] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 14:29:51 2022] DELETE /identity/v3/users/3577467b06e847b997e004411c459d6a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:29:51.828636 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70754942-86b4-49d5-9a6d-626e92c1bd94 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.829087 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70754942-86b4-49d5-9a6d-626e92c1bd94 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.829192 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70754942-86b4-49d5-9a6d-626e92c1bd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:51.847548 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-70754942-86b4-49d5-9a6d-626e92c1bd94 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:29:51.848732 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-70754942-86b4-49d5-9a6d-626e92c1bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:29:51.907101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 581/1125] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:29:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:29:51.917254 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:29:51.918717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:29:51.994378 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f81e47-6ea6-4a95-9eb3-1f3518c8f5dc admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:29:51.997995 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac207b07-008a-47b5-8da6-ae3d09583a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:29:51.998659 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac207b07-008a-47b5-8da6-ae3d09583a30 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:51.998955 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac207b07-008a-47b5-8da6-ae3d09583a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:51.999240 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac207b07-008a-47b5-8da6-ae3d09583a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:52.008983 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac207b07-008a-47b5-8da6-ae3d09583a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:29:52.010417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac207b07-008a-47b5-8da6-ae3d09583a30 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:29:52.019909 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 545/1126] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:29:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:29:52.538169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70754942-86b4-49d5-9a6d-626e92c1bd94 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:29:52.538169 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-70754942-86b4-49d5-9a6d-626e92c1bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:29:52.548407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70754942-86b4-49d5-9a6d-626e92c1bd94 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:29:52.553697 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:29:52.554570 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:29:52.554888 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:29:52.555170 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] PATH_INFO: `/v3/projects/bb32d2e0befd459ba2e604e93bf4d178` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:29:52.556869 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb32d2e0befd459ba2e604e93bf4d178)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:29:52.557522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: WARNING py.warnings [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:29:52.557522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: warnings.warn(msg) Jun 02 14:29:52.557522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: Jun 02 14:29:52.558918 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:29:52.717152 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb32d2e0befd459ba2e604e93bf4d178', 'request_id': 'req-c0d840e6-5228-4029-a639-4a8aa9cf6bad'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:29:52.735033 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb32d2e0befd459ba2e604e93bf4d178', 'request_id': 'req-c0d840e6-5228-4029-a639-4a8aa9cf6bad'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:29:52.821049 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb32d2e0befd459ba2e604e93bf4d178', 'request_id': 'req-c0d840e6-5228-4029-a639-4a8aa9cf6bad'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:29:52.835042 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] The token cache is being invalidate because project bb32d2e0befd459ba2e604e93bf4d178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:29:52.835789 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:29:52.836831 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c0d840e6-5228-4029-a639-4a8aa9cf6bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:29:52.838784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 582/1127] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 14:29:52 2022] DELETE /identity/v3/projects/bb32d2e0befd459ba2e604e93bf4d178 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:30:02.015642 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=34 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:30:02.831586 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:31:19.678277 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120dd1d-5e0a-46dd-be71-7d7ad213e7fd None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:19.678803 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120dd1d-5e0a-46dd-be71-7d7ad213e7fd None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:19.678912 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120dd1d-5e0a-46dd-be71-7d7ad213e7fd None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:19.680713 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 546/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:31:19.685904 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e42bd-e1e8-4499-b0c6-f8cedf47ac11 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:19.686402 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e42bd-e1e8-4499-b0c6-f8cedf47ac11 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:19.686497 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e42bd-e1e8-4499-b0c6-f8cedf47ac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:19.707655 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-855e42bd-e1e8-4499-b0c6-f8cedf47ac11 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:31:19.709004 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-855e42bd-e1e8-4499-b0c6-f8cedf47ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:19.772046 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 583/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:31:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:31:19.947958 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120dd1d-5e0a-46dd-be71-7d7ad213e7fd None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:31:19.949748 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-1120dd1d-5e0a-46dd-be71-7d7ad213e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:20.029957 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120dd1d-5e0a-46dd-be71-7d7ad213e7fd None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:31:20.038709 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4842-928f-4495-8df5-5439af540782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:31:20.039404 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4842-928f-4495-8df5-5439af540782 service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:20.039692 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4842-928f-4495-8df5-5439af540782 service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:20.039972 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4842-928f-4495-8df5-5439af540782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:20.048468 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b4842-928f-4495-8df5-5439af540782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:31:20.050071 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b4842-928f-4495-8df5-5439af540782 service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:31:20.060083 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 547/1130] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:31:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:31:20.944319 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b8536-9dd9-47e5-bf04-d97162078fa3 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:20.944875 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b8536-9dd9-47e5-bf04-d97162078fa3 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:20.945005 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b8536-9dd9-47e5-bf04-d97162078fa3 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:20.946282 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 584/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:31:20.951168 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3bf73-65e7-4f9b-a996-3d82fe809a6c None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:20.951585 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3bf73-65e7-4f9b-a996-3d82fe809a6c None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:20.951736 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3bf73-65e7-4f9b-a996-3d82fe809a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:20.970193 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-46c3bf73-65e7-4f9b-a996-3d82fe809a6c None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:31:20.971435 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-46c3bf73-65e7-4f9b-a996-3d82fe809a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:20.979967 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 548/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:31:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:31:21.133265 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b8536-9dd9-47e5-bf04-d97162078fa3 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:31:21.147379 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b8536-9dd9-47e5-bf04-d97162078fa3 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:31:21.152272 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda420e9-8156-480b-9d5c-c7a24f1ba633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:31:21.152902 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda420e9-8156-480b-9d5c-c7a24f1ba633 service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:21.153182 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda420e9-8156-480b-9d5c-c7a24f1ba633 service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:21.153456 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda420e9-8156-480b-9d5c-c7a24f1ba633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:21.162423 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda420e9-8156-480b-9d5c-c7a24f1ba633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:31:21.164048 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda420e9-8156-480b-9d5c-c7a24f1ba633 service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:31:21.173409 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 585/1133] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:31:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:31:25.661125 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8998c19-cc8f-4465-bc9a-e6e71afb1d56 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:25.661634 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8998c19-cc8f-4465-bc9a-e6e71afb1d56 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:25.661634 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8998c19-cc8f-4465-bc9a-e6e71afb1d56 None None] PATH_INFO: `/v3` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:25.662919 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 549/1134] 10.222.0.72 () {54 vars in 925 bytes} [Thu Jun 2 14:31:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:31:25.669328 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a723-9f07-4456-a892-de02e3ea602f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:25.669784 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a723-9f07-4456-a892-de02e3ea602f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:25.669881 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3a723-9f07-4456-a892-de02e3ea602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:25.700629 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-9ea3a723-9f07-4456-a892-de02e3ea602f None None] MFA Rules not processed for user `f2fb1743d8104deea9914b232c944962`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:31:25.702010 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-9ea3a723-9f07-4456-a892-de02e3ea602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:25.763825 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 586/1135] 10.222.0.72 () {58 vars in 1015 bytes} [Thu Jun 2 14:31:25 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:31:30.296183 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ff930-24c1-4889-a6b2-a7f688345db8 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:30.296692 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ff930-24c1-4889-a6b2-a7f688345db8 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:30.296692 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ff930-24c1-4889-a6b2-a7f688345db8 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:30.298060 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 550/1136] 10.222.0.59 () {54 vars in 960 bytes} [Thu Jun 2 14:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:31:30.303660 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18027e83-369d-410e-91f1-e98425547cf6 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:30.304105 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18027e83-369d-410e-91f1-e98425547cf6 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:30.304258 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18027e83-369d-410e-91f1-e98425547cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:30.322585 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-18027e83-369d-410e-91f1-e98425547cf6 None None] MFA Rules not processed for user `f2fb1743d8104deea9914b232c944962`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:31:30.323809 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-18027e83-369d-410e-91f1-e98425547cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:30.332444 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 587/1137] 10.222.0.59 () {58 vars in 1057 bytes} [Thu Jun 2 14:31:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:31:30.340590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ff930-24c1-4889-a6b2-a7f688345db8 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:31:30.354260 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ff930-24c1-4889-a6b2-a7f688345db8 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:31:30.359202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1a22e-72f7-4fcb-98c6-7f01a42f6baf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fb1743d8104deea9914b232c944962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:31:30.359829 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a22e-72f7-4fcb-98c6-7f01a42f6baf service placement] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:30.360114 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a22e-72f7-4fcb-98c6-7f01a42f6baf service placement] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:30.360390 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a22e-72f7-4fcb-98c6-7f01a42f6baf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:30.368882 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1a22e-72f7-4fcb-98c6-7f01a42f6baf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:31:30.370480 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1a22e-72f7-4fcb-98c6-7f01a42f6baf service placement] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:31:30.381182 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 551/1138] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:31:30 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:31:32.520599 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55604f86-d0ec-4a8e-8ac7-1133c46e6542 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:32.521647 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55604f86-d0ec-4a8e-8ac7-1133c46e6542 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:32.521761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55604f86-d0ec-4a8e-8ac7-1133c46e6542 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:32.523309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 588/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:31:32.528215 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea45aa-179f-4d5d-9d33-eea5599849bc None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:32.528642 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea45aa-179f-4d5d-9d33-eea5599849bc None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:32.528769 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea45aa-179f-4d5d-9d33-eea5599849bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:32.546709 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-20ea45aa-179f-4d5d-9d33-eea5599849bc None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:31:32.548050 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-20ea45aa-179f-4d5d-9d33-eea5599849bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:32.556431 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 552/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:31:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:31:32.713565 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55604f86-d0ec-4a8e-8ac7-1133c46e6542 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:31:32.727555 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55604f86-d0ec-4a8e-8ac7-1133c46e6542 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:31:32.732601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f70754-0f31-462e-b9e7-4c5580153627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:31:32.733244 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70754-0f31-462e-b9e7-4c5580153627 service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:32.733534 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70754-0f31-462e-b9e7-4c5580153627 service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:32.733818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70754-0f31-462e-b9e7-4c5580153627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:32.742326 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f70754-0f31-462e-b9e7-4c5580153627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:31:32.743985 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f70754-0f31-462e-b9e7-4c5580153627 service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:31:32.753814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 589/1141] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:31:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:31:33.628063 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721b114-c05d-4344-a67a-5a7e3d1d4eaa None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:33.628594 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721b114-c05d-4344-a67a-5a7e3d1d4eaa None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:33.628594 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721b114-c05d-4344-a67a-5a7e3d1d4eaa None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:33.629959 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 553/1142] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 14:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:31:33.634844 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfbe08-3c28-4991-b629-ff6875004d5a None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:33.635248 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfbe08-3c28-4991-b629-ff6875004d5a None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:33.635406 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfbe08-3c28-4991-b629-ff6875004d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:33.656000 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-64dfbe08-3c28-4991-b629-ff6875004d5a None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:31:33.657194 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-64dfbe08-3c28-4991-b629-ff6875004d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:33.665765 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 590/1143] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 14:31:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:31:33.819538 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721b114-c05d-4344-a67a-5a7e3d1d4eaa None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:31:33.833092 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721b114-c05d-4344-a67a-5a7e3d1d4eaa None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:31:33.838058 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a0a22-a4cd-4895-84bb-fcdfac43ccdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:31:33.838728 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0a22-a4cd-4895-84bb-fcdfac43ccdb service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:33.839017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0a22-a4cd-4895-84bb-fcdfac43ccdb service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:33.839301 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0a22-a4cd-4895-84bb-fcdfac43ccdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:33.847350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a0a22-a4cd-4895-84bb-fcdfac43ccdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:31:33.849123 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a0a22-a4cd-4895-84bb-fcdfac43ccdb service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:31:33.858280 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 554/1144] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:31:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:31:38.064689 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1870090-c4e8-42f5-991d-cc60d61eec12 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:38.065277 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1870090-c4e8-42f5-991d-cc60d61eec12 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:38.065277 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1870090-c4e8-42f5-991d-cc60d61eec12 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:38.067439 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 591/1145] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:31:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:31:38.072897 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391278e9-5790-4f99-9fe9-aa1d993197aa None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:38.073398 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391278e9-5790-4f99-9fe9-aa1d993197aa None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:38.073500 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391278e9-5790-4f99-9fe9-aa1d993197aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:38.094993 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-391278e9-5790-4f99-9fe9-aa1d993197aa None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:31:38.096309 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-391278e9-5790-4f99-9fe9-aa1d993197aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:38.105055 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 555/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:31:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:31:38.152240 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1870090-c4e8-42f5-991d-cc60d61eec12 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:31:38.153926 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-b1870090-c4e8-42f5-991d-cc60d61eec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:38.211983 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:31:38.217469 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1870090-c4e8-42f5-991d-cc60d61eec12 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:31:38.221014 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3984882-e298-4d1f-81f5-3799e617fe15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:31:38.221680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984882-e298-4d1f-81f5-3799e617fe15 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:38.221997 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984882-e298-4d1f-81f5-3799e617fe15 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:38.222269 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3984882-e298-4d1f-81f5-3799e617fe15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:38.231374 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3984882-e298-4d1f-81f5-3799e617fe15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:31:38.232855 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3984882-e298-4d1f-81f5-3799e617fe15 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:31:38.243330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 592/1147] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:31:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:31:40.581392 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64418eb1-1fb7-40fa-8790-16dbea1d3ae5 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:40.582008 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64418eb1-1fb7-40fa-8790-16dbea1d3ae5 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:40.582008 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64418eb1-1fb7-40fa-8790-16dbea1d3ae5 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:40.583472 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 556/1148] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:31:40.588682 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72586e8d-3ddc-48c5-b798-3f8f3377b10b None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:40.589127 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72586e8d-3ddc-48c5-b798-3f8f3377b10b None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:40.589304 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72586e8d-3ddc-48c5-b798-3f8f3377b10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:40.608040 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-72586e8d-3ddc-48c5-b798-3f8f3377b10b None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:31:40.609265 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-72586e8d-3ddc-48c5-b798-3f8f3377b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:40.617704 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 593/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:31:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:31:40.655520 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64418eb1-1fb7-40fa-8790-16dbea1d3ae5 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:31:40.666454 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64418eb1-1fb7-40fa-8790-16dbea1d3ae5 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:31:40.671383 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11497d05-d924-4ce8-bcb8-1b1fb61b33d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:31:40.672029 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11497d05-d924-4ce8-bcb8-1b1fb61b33d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:40.672309 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11497d05-d924-4ce8-bcb8-1b1fb61b33d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:40.672584 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11497d05-d924-4ce8-bcb8-1b1fb61b33d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:40.682610 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11497d05-d924-4ce8-bcb8-1b1fb61b33d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:31:40.684070 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11497d05-d924-4ce8-bcb8-1b1fb61b33d2 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:31:40.694489 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 557/1150] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:31:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:31:44.422626 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b7432-78fa-47c2-8b20-bcec5b915c7c None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:44.423236 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b7432-78fa-47c2-8b20-bcec5b915c7c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:44.423236 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b7432-78fa-47c2-8b20-bcec5b915c7c None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:44.424610 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 594/1151] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:31:44.430505 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0cef7-7ae3-4bd8-994a-d3be065ddc25 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:44.432946 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0cef7-7ae3-4bd8-994a-d3be065ddc25 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:44.432946 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0cef7-7ae3-4bd8-994a-d3be065ddc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:44.437364 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=60 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:31:44.449870 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-45d0cef7-7ae3-4bd8-994a-d3be065ddc25 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:31:44.451215 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-45d0cef7-7ae3-4bd8-994a-d3be065ddc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:44.459122 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 558/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:31:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:31:44.732454 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b7432-78fa-47c2-8b20-bcec5b915c7c None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:31:44.734141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-502b7432-78fa-47c2-8b20-bcec5b915c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:44.792611 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b7432-78fa-47c2-8b20-bcec5b915c7c None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:31:44.796183 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00ba18-22de-490e-875a-27dc0e18c332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1518eb388a24af9b85e968802e70237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:31:44.796831 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ba18-22de-490e-875a-27dc0e18c332 service cinder] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:44.797125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ba18-22de-490e-875a-27dc0e18c332 service cinder] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:44.797408 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00ba18-22de-490e-875a-27dc0e18c332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:44.807223 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00ba18-22de-490e-875a-27dc0e18c332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:31:44.808689 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00ba18-22de-490e-875a-27dc0e18c332 service cinder] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:31:44.818402 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 595/1153] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:31:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:31:47.164226 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1245-5357-4aba-9b3a-f251131186c4 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:47.164754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1245-5357-4aba-9b3a-f251131186c4 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:47.164754 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1245-5357-4aba-9b3a-f251131186c4 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:47.166078 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 559/1154] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 14:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:31:47.171369 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e50be-1b8e-4ac7-a5c4-daee77afce99 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:47.171813 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e50be-1b8e-4ac7-a5c4-daee77afce99 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:47.171929 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e50be-1b8e-4ac7-a5c4-daee77afce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:47.191781 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-eb5e50be-1b8e-4ac7-a5c4-daee77afce99 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:31:47.192991 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-eb5e50be-1b8e-4ac7-a5c4-daee77afce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:47.201091 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 596/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 14:31:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:31:47.479695 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f1245-5357-4aba-9b3a-f251131186c4 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:31:47.481410 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-a58f1245-5357-4aba-9b3a-f251131186c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:31:47.494294 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f1245-5357-4aba-9b3a-f251131186c4 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:31:47.497787 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc70ac5-6022-46f4-96ce-4a2314a65c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1518eb388a24af9b85e968802e70237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:31:47.498415 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc70ac5-6022-46f4-96ce-4a2314a65c60 service cinder] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:31:47.498897 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc70ac5-6022-46f4-96ce-4a2314a65c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:31:47.499180 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc70ac5-6022-46f4-96ce-4a2314a65c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:31:47.508799 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc70ac5-6022-46f4-96ce-4a2314a65c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:31:47.510218 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc70ac5-6022-46f4-96ce-4a2314a65c60 service cinder] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:31:47.520417 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 560/1156] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:31:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:31:57.185677 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=37 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:31:57.515554 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=8 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:08.696045 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5d13-cb12-449b-9464-7c9ddb488863 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:08.696719 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5d13-cb12-449b-9464-7c9ddb488863 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:08.696719 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5d13-cb12-449b-9464-7c9ddb488863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:08.702626 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01065a9-50e8-4989-ad1c-e9a8140e3e57 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:08.703126 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01065a9-50e8-4989-ad1c-e9a8140e3e57 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:08.703236 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01065a9-50e8-4989-ad1c-e9a8140e3e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:08.719578 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-477c5d13-cb12-449b-9464-7c9ddb488863 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:08.721811 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-b01065a9-50e8-4989-ad1c-e9a8140e3e57 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:08.721951 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-477c5d13-cb12-449b-9464-7c9ddb488863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:08.723399 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-b01065a9-50e8-4989-ad1c-e9a8140e3e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:08.731816 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 597/1157] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:08.731982 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 561/1158] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:33:08.740082 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a598f-4001-4cf6-b04e-9034a1701a86 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:08.740276 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6bee-bbaf-440c-b625-0c67d307a84f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:08.740413 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a598f-4001-4cf6-b04e-9034a1701a86 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:08.740529 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6bee-bbaf-440c-b625-0c67d307a84f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:08.740694 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a598f-4001-4cf6-b04e-9034a1701a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:08.740804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6bee-bbaf-440c-b625-0c67d307a84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:08.759693 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-cc4a598f-4001-4cf6-b04e-9034a1701a86 None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:08.760898 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-cc4a598f-4001-4cf6-b04e-9034a1701a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:08.765681 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-85ec6bee-bbaf-440c-b625-0c67d307a84f None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:08.766896 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-85ec6bee-bbaf-440c-b625-0c67d307a84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:08.768851 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 562/1159] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:08.773985 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a598f-4001-4cf6-b04e-9034a1701a86 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:08.775897 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 598/1160] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:08.780937 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec6bee-bbaf-440c-b625-0c67d307a84f None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:08.783438 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a598f-4001-4cf6-b04e-9034a1701a86 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:08.788537 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2d71e-4543-4f2a-87b6-520865d6bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:08.789195 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2d71e-4543-4f2a-87b6-520865d6bd98 admin admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:08.789479 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2d71e-4543-4f2a-87b6-520865d6bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:08.789756 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2d71e-4543-4f2a-87b6-520865d6bd98 admin admin] PATH_INFO: `/v3/domains` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:08.790193 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec6bee-bbaf-440c-b625-0c67d307a84f None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:08.790488 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2d71e-4543-4f2a-87b6-520865d6bd98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:33:08.790845 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2d71e-4543-4f2a-87b6-520865d6bd98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:08.791869 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: WARNING py.warnings [None req-22c2d71e-4543-4f2a-87b6-520865d6bd98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:33:08.791869 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: warnings.warn(msg) Jun 02 14:33:08.791869 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: Jun 02 14:33:08.792751 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2d71e-4543-4f2a-87b6-520865d6bd98 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:08.795692 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4711f-1faf-4139-8b7f-dcf52d41d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:08.796384 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4711f-1faf-4139-8b7f-dcf52d41d6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:08.796670 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4711f-1faf-4139-8b7f-dcf52d41d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:08.796950 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4711f-1faf-4139-8b7f-dcf52d41d6c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:08.797708 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4711f-1faf-4139-8b7f-dcf52d41d6c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:33:08.798020 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4711f-1faf-4139-8b7f-dcf52d41d6c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:08.800502 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4711f-1faf-4139-8b7f-dcf52d41d6c8 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:08.805767 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 563/1161] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 14:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:33:08.813574 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2d71e-4543-4f2a-87b6-520865d6bd98 admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:08.814493 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 599/1162] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Jun 2 14:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:33:08.822601 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4711f-1faf-4139-8b7f-dcf52d41d6c8 admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:08.824669 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2d71e-4543-4f2a-87b6-520865d6bd98 admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:08.829367 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06924e-12d5-451d-9174-85d61629bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:08.830018 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06924e-12d5-451d-9174-85d61629bcbd admin admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:08.830309 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06924e-12d5-451d-9174-85d61629bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:08.830593 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06924e-12d5-451d-9174-85d61629bcbd admin admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:08.832032 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06924e-12d5-451d-9174-85d61629bcbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:08.832927 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4711f-1faf-4139-8b7f-dcf52d41d6c8 admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:08.834310 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06924e-12d5-451d-9174-85d61629bcbd admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:08.837508 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919eab5-ad6b-4642-bc70-3abb2918bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:08.838141 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919eab5-ad6b-4642-bc70-3abb2918bf4c admin admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:08.838426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919eab5-ad6b-4642-bc70-3abb2918bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:08.838743 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919eab5-ad6b-4642-bc70-3abb2918bf4c admin admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:08.839426 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919eab5-ad6b-4642-bc70-3abb2918bf4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:08.840431 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: WARNING py.warnings [None req-d919eab5-ad6b-4642-bc70-3abb2918bf4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:33:08.840431 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: warnings.warn(msg) Jun 02 14:33:08.840431 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: Jun 02 14:33:08.841603 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919eab5-ad6b-4642-bc70-3abb2918bf4c admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:08.952704 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 564/1163] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 14:33:08 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:33:08.957184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06924e-12d5-451d-9174-85d61629bcbd admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:08.967556 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 600/1164] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 14:33:08 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:33:08.968599 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919eab5-ad6b-4642-bc70-3abb2918bf4c admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:09.021192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06924e-12d5-451d-9174-85d61629bcbd admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:09.034097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919eab5-ad6b-4642-bc70-3abb2918bf4c admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:09.039164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43b094-3bc2-42ac-916b-cf9c9c0a8e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:09.039836 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43b094-3bc2-42ac-916b-cf9c9c0a8e86 admin admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.040125 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43b094-3bc2-42ac-916b-cf9c9c0a8e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.040405 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43b094-3bc2-42ac-916b-cf9c9c0a8e86 admin admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.041098 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43b094-3bc2-42ac-916b-cf9c9c0a8e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:09.043147 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43b094-3bc2-42ac-916b-cf9c9c0a8e86 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:09.077869 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b9f24-8cd1-442b-a237-7d90c598d12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:09.078548 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9f24-8cd1-442b-a237-7d90c598d12e admin admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.078869 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9f24-8cd1-442b-a237-7d90c598d12e admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.079149 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9f24-8cd1-442b-a237-7d90c598d12e admin admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.079841 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b9f24-8cd1-442b-a237-7d90c598d12e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:09.080871 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: WARNING py.warnings [None req-7a4b9f24-8cd1-442b-a237-7d90c598d12e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:33:09.080871 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: warnings.warn(msg) Jun 02 14:33:09.080871 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: Jun 02 14:33:09.082284 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b9f24-8cd1-442b-a237-7d90c598d12e admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:09.186474 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 601/1165] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 14:33:08 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:33:09.191491 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43b094-3bc2-42ac-916b-cf9c9c0a8e86 admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:09.201497 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43b094-3bc2-42ac-916b-cf9c9c0a8e86 admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:09.206254 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1f920-5572-4850-8b3d-0eb19b5d04f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:09.206942 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1f920-5572-4850-8b3d-0eb19b5d04f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.207270 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1f920-5572-4850-8b3d-0eb19b5d04f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.207491 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1f920-5572-4850-8b3d-0eb19b5d04f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.208223 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1f920-5572-4850-8b3d-0eb19b5d04f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:09.209857 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1f920-5572-4850-8b3d-0eb19b5d04f9 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:09.216050 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 565/1166] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 14:33:08 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:33:09.223094 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 602/1167] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 14:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:33:09.223260 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b9f24-8cd1-442b-a237-7d90c598d12e admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:09.224180 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1f920-5572-4850-8b3d-0eb19b5d04f9 admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:09.231903 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b9f24-8cd1-442b-a237-7d90c598d12e admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:09.233914 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1f920-5572-4850-8b3d-0eb19b5d04f9 admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:09.237034 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a266360-57b2-4229-a214-b95b4fb479ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:09.238366 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a266360-57b2-4229-a214-b95b4fb479ac admin admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.238681 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a266360-57b2-4229-a214-b95b4fb479ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.238987 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a266360-57b2-4229-a214-b95b4fb479ac admin admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.239584 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea5201-4ecb-4452-8499-13fcbeaa6f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:09.239739 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a266360-57b2-4229-a214-b95b4fb479ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:09.240234 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea5201-4ecb-4452-8499-13fcbeaa6f31 admin admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.240522 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea5201-4ecb-4452-8499-13fcbeaa6f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.240800 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea5201-4ecb-4452-8499-13fcbeaa6f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.241349 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a266360-57b2-4229-a214-b95b4fb479ac admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:09.241519 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea5201-4ecb-4452-8499-13fcbeaa6f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:09.243137 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea5201-4ecb-4452-8499-13fcbeaa6f31 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:09.255207 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 566/1168] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 14:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:33:09.255378 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 603/1169] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 14:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:33:09.258759 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea5201-4ecb-4452-8499-13fcbeaa6f31 admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:09.258894 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a266360-57b2-4229-a214-b95b4fb479ac admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:09.274163 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a266360-57b2-4229-a214-b95b4fb479ac admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:09.274324 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea5201-4ecb-4452-8499-13fcbeaa6f31 admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:09.281265 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42c083-60a1-472e-85ae-52f2c296c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:09.281416 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdea54d-b6f3-4af7-96e8-b1fd3c1c5b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:09.282308 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c083-60a1-472e-85ae-52f2c296c674 admin admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.282673 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea54d-b6f3-4af7-96e8-b1fd3c1c5b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.282806 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c083-60a1-472e-85ae-52f2c296c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.283151 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea54d-b6f3-4af7-96e8-b1fd3c1c5b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.283258 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c083-60a1-472e-85ae-52f2c296c674 admin admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.283607 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea54d-b6f3-4af7-96e8-b1fd3c1c5b68 admin admin] PATH_INFO: `/v3/projects/3e2d83635dab4b1cbaf3ecde5626623c/users/3a1da526fec84abbabd73c479d366966/roles/3ce491f94839419ea9ba3b84324fcd8f` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.285182 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42c083-60a1-472e-85ae-52f2c296c674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:09.288034 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42c083-60a1-472e-85ae-52f2c296c674 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:09.299032 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 567/1170] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 14:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:33:09.304300 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdea54d-b6f3-4af7-96e8-b1fd3c1c5b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2d83635dab4b1cbaf3ecde5626623c, user_id=3a1da526fec84abbabd73c479d366966, role_id=3ce491f94839419ea9ba3b84324fcd8f)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:09.304300 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: WARNING py.warnings [None req-9cdea54d-b6f3-4af7-96e8-b1fd3c1c5b68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:33:09.304300 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: warnings.warn(msg) Jun 02 14:33:09.304300 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: Jun 02 14:33:09.304662 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42c083-60a1-472e-85ae-52f2c296c674 admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:09.305200 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdea54d-b6f3-4af7-96e8-b1fd3c1c5b68 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:09.313498 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42c083-60a1-472e-85ae-52f2c296c674 admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:09.318223 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789e35f-c824-4af9-9782-b433c4cb01d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:09.319127 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789e35f-c824-4af9-9782-b433c4cb01d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.319408 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789e35f-c824-4af9-9782-b433c4cb01d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.319684 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789e35f-c824-4af9-9782-b433c4cb01d2 admin admin] PATH_INFO: `/v3/projects/6ba0f2723d364f169cc68eabac2b0427/users/dd6fd19ff66f47f8b93704a90f19d53b/roles/3ce491f94839419ea9ba3b84324fcd8f` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.334271 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789e35f-c824-4af9-9782-b433c4cb01d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba0f2723d364f169cc68eabac2b0427, user_id=dd6fd19ff66f47f8b93704a90f19d53b, role_id=3ce491f94839419ea9ba3b84324fcd8f)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:09.336942 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789e35f-c824-4af9-9782-b433c4cb01d2 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:09.395314 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 604/1171] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 14:33:09 2022] PUT /identity/v3/projects/3e2d83635dab4b1cbaf3ecde5626623c/users/3a1da526fec84abbabd73c479d366966/roles/3ce491f94839419ea9ba3b84324fcd8f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:33:09.400274 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdaca2-c6dc-4b0e-90f8-70daba9fe73c None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.400564 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdaca2-c6dc-4b0e-90f8-70daba9fe73c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.400849 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdaca2-c6dc-4b0e-90f8-70daba9fe73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.413533 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 568/1172] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 14:33:09 2022] PUT /identity/v3/projects/6ba0f2723d364f169cc68eabac2b0427/users/dd6fd19ff66f47f8b93704a90f19d53b/roles/3ce491f94839419ea9ba3b84324fcd8f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:33:09.418411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f47a1-df36-4735-bd5c-0ce6f54ed14a None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.418724 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f47a1-df36-4735-bd5c-0ce6f54ed14a None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.419003 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f47a1-df36-4735-bd5c-0ce6f54ed14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.420136 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-2fbdaca2-c6dc-4b0e-90f8-70daba9fe73c None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:09.421349 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-2fbdaca2-c6dc-4b0e-90f8-70daba9fe73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:09.424783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:09.437490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-217f47a1-df36-4735-bd5c-0ce6f54ed14a None None] MFA Rules not processed for user `178ae9fcbcd542059cfd780cab7fed93`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:09.438831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-217f47a1-df36-4735-bd5c-0ce6f54ed14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:09.471211 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:09.482768 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 605/1173] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:33:09.492808 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdaca2-c6dc-4b0e-90f8-70daba9fe73c None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:09.498903 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 569/1174] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:33:09.509647 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f47a1-df36-4735-bd5c-0ce6f54ed14a None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:09.550466 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdaca2-c6dc-4b0e-90f8-70daba9fe73c None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:09.554175 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adb6d2-c078-44c2-b608-3e68c9bc3c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:09.554856 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adb6d2-c078-44c2-b608-3e68c9bc3c11 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.555241 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adb6d2-c078-44c2-b608-3e68c9bc3c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.555525 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adb6d2-c078-44c2-b608-3e68c9bc3c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.564880 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adb6d2-c078-44c2-b608-3e68c9bc3c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:09.565122 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f47a1-df36-4735-bd5c-0ce6f54ed14a None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:09.566951 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adb6d2-c078-44c2-b608-3e68c9bc3c11 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:09.570704 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca3db5-76b3-4c62-994d-c19d0608ba92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:09.571356 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca3db5-76b3-4c62-994d-c19d0608ba92 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:09.571647 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca3db5-76b3-4c62-994d-c19d0608ba92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:09.571931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca3db5-76b3-4c62-994d-c19d0608ba92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:09.576618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 606/1175] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:33:09.582134 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca3db5-76b3-4c62-994d-c19d0608ba92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:09.583617 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca3db5-76b3-4c62-994d-c19d0608ba92 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:09.593663 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 570/1176] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:33:16.499197 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1bbf-03f4-4745-8436-823690a4167f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:16.499680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1bbf-03f4-4745-8436-823690a4167f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:16.499680 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c1bbf-03f4-4745-8436-823690a4167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:16.552655 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-9a2c1bbf-03f4-4745-8436-823690a4167f None None] MFA Rules not processed for user `dd6fd19ff66f47f8b93704a90f19d53b`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:16.552655 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-9a2c1bbf-03f4-4745-8436-823690a4167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:16.588643 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f65bb6-7a1a-433c-b854-efe781274508 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:16.589218 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f65bb6-7a1a-433c-b854-efe781274508 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:16.589218 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f65bb6-7a1a-433c-b854-efe781274508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:16.631001 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-45f65bb6-7a1a-433c-b854-efe781274508 None None] MFA Rules not processed for user `3a1da526fec84abbabd73c479d366966`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:16.634757 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-45f65bb6-7a1a-433c-b854-efe781274508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:16.678354 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 607/1177] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:16 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:16.686876 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1bbf-03f4-4745-8436-823690a4167f None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:16.704998 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c1bbf-03f4-4745-8436-823690a4167f None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:16.711238 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24fef7-dfbc-4d67-aece-60f661f7ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:16.711929 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24fef7-dfbc-4d67-aece-60f661f7ef53 admin admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:16.712218 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24fef7-dfbc-4d67-aece-60f661f7ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:16.712501 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24fef7-dfbc-4d67-aece-60f661f7ef53 admin admin] PATH_INFO: `/v3/projects` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:16.713217 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24fef7-dfbc-4d67-aece-60f661f7ef53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:16.715309 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24fef7-dfbc-4d67-aece-60f661f7ef53 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:16.759339 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 571/1178] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:16 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:33:16.763557 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f65bb6-7a1a-433c-b854-efe781274508 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:16.775192 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f65bb6-7a1a-433c-b854-efe781274508 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:16.779977 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb5f64-0cef-4f27-aeca-ce32faf15af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:16.780655 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb5f64-0cef-4f27-aeca-ce32faf15af4 admin admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:16.781089 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb5f64-0cef-4f27-aeca-ce32faf15af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:16.781371 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb5f64-0cef-4f27-aeca-ce32faf15af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:16.782221 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb5f64-0cef-4f27-aeca-ce32faf15af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:16.784925 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb5f64-0cef-4f27-aeca-ce32faf15af4 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:16.841575 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 608/1179] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 14:33:16 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:33:16.845867 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24fef7-dfbc-4d67-aece-60f661f7ef53 admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:16.893476 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 572/1180] 10.222.0.59 () {60 vars in 1152 bytes} [Thu Jun 2 14:33:16 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:33:16.898988 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb5f64-0cef-4f27-aeca-ce32faf15af4 admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:16.916151 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:16.924016 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24fef7-dfbc-4d67-aece-60f661f7ef53 admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:16.935663 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:16.982768 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb5f64-0cef-4f27-aeca-ce32faf15af4 admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:16.989591 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe5651-28d9-476d-8b54-30f7f80a1f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:16.990288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5651-28d9-476d-8b54-30f7f80a1f70 admin admin] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:16.990572 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5651-28d9-476d-8b54-30f7f80a1f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:16.990888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5651-28d9-476d-8b54-30f7f80a1f70 admin admin] PATH_INFO: `/v3/users` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:16.991716 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe5651-28d9-476d-8b54-30f7f80a1f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:16.993672 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe5651-28d9-476d-8b54-30f7f80a1f70 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:16.994165 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb19c0d-17ab-4cac-a0b0-a075b0a96d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:16.995062 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb19c0d-17ab-4cac-a0b0-a075b0a96d35 admin admin] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:16.995351 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb19c0d-17ab-4cac-a0b0-a075b0a96d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:16.995627 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb19c0d-17ab-4cac-a0b0-a075b0a96d35 admin admin] PATH_INFO: `/v3/users` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:16.996331 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb19c0d-17ab-4cac-a0b0-a075b0a96d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:16.998350 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb19c0d-17ab-4cac-a0b0-a075b0a96d35 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:17.131720 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 573/1181] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 14:33:16 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:33:17.135686 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe5651-28d9-476d-8b54-30f7f80a1f70 admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:17.136136 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 609/1182] 10.222.0.59 () {60 vars in 1143 bytes} [Thu Jun 2 14:33:16 2022] POST /identity/v3/users => generated 295 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:33:17.139368 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb19c0d-17ab-4cac-a0b0-a075b0a96d35 admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:17.147806 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe5651-28d9-476d-8b54-30f7f80a1f70 admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:17.151190 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb19c0d-17ab-4cac-a0b0-a075b0a96d35 admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:17.153467 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b89db5-7586-4761-91d7-671ec11ddc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:17.154179 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b89db5-7586-4761-91d7-671ec11ddc65 admin admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:17.154464 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b89db5-7586-4761-91d7-671ec11ddc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:17.154778 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b89db5-7586-4761-91d7-671ec11ddc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:17.155515 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b89db5-7586-4761-91d7-671ec11ddc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:17.157133 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b89db5-7586-4761-91d7-671ec11ddc65 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:17.157512 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50b297-d802-4c6c-a9b5-d73c9f2b04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:17.158101 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50b297-d802-4c6c-a9b5-d73c9f2b04ba admin admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:17.158489 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50b297-d802-4c6c-a9b5-d73c9f2b04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:17.159396 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50b297-d802-4c6c-a9b5-d73c9f2b04ba admin admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:17.160472 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50b297-d802-4c6c-a9b5-d73c9f2b04ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:17.162172 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50b297-d802-4c6c-a9b5-d73c9f2b04ba admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:17.173801 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 574/1183] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 14:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:33:17.181037 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b89db5-7586-4761-91d7-671ec11ddc65 admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:17.182391 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 610/1184] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 14:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:33:17.186370 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50b297-d802-4c6c-a9b5-d73c9f2b04ba admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:17.194454 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b89db5-7586-4761-91d7-671ec11ddc65 admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:17.198613 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50b297-d802-4c6c-a9b5-d73c9f2b04ba admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:17.200280 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3164a-226f-40f7-bd2a-021a66a09ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:17.201247 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3164a-226f-40f7-bd2a-021a66a09ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:17.201535 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3164a-226f-40f7-bd2a-021a66a09ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:17.201812 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3164a-226f-40f7-bd2a-021a66a09ab2 admin admin] PATH_INFO: `/v3/projects/0738cf235d7947cf81203ad56d183c75/users/a967f6f0bb694ebd92090ced0d67d180/roles/61482861f00e45048fc1d45570c4c99b` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:17.204370 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db25ae-5613-4dcf-8aba-c71f735d4a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:17.207588 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db25ae-5613-4dcf-8aba-c71f735d4a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:17.207588 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db25ae-5613-4dcf-8aba-c71f735d4a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:17.207820 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db25ae-5613-4dcf-8aba-c71f735d4a42 admin admin] PATH_INFO: `/v3/projects/3df1812bb69d44b58a96bfcce0157e3f/users/d200ac09ec524dfe8da490bc44b28771/roles/61482861f00e45048fc1d45570c4c99b` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:17.221600 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3164a-226f-40f7-bd2a-021a66a09ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0738cf235d7947cf81203ad56d183c75, user_id=a967f6f0bb694ebd92090ced0d67d180, role_id=61482861f00e45048fc1d45570c4c99b)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:17.224848 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3164a-226f-40f7-bd2a-021a66a09ab2 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:17.231768 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db25ae-5613-4dcf-8aba-c71f735d4a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df1812bb69d44b58a96bfcce0157e3f, user_id=d200ac09ec524dfe8da490bc44b28771, role_id=61482861f00e45048fc1d45570c4c99b)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:17.234614 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db25ae-5613-4dcf-8aba-c71f735d4a42 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:17.319368 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 575/1185] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 14:33:17 2022] PUT /identity/v3/projects/0738cf235d7947cf81203ad56d183c75/users/a967f6f0bb694ebd92090ced0d67d180/roles/61482861f00e45048fc1d45570c4c99b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:33:17.320350 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3164a-226f-40f7-bd2a-021a66a09ab2 admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:17.329303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 611/1186] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 14:33:17 2022] PUT /identity/v3/projects/3df1812bb69d44b58a96bfcce0157e3f/users/d200ac09ec524dfe8da490bc44b28771/roles/61482861f00e45048fc1d45570c4c99b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:33:17.333255 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db25ae-5613-4dcf-8aba-c71f735d4a42 admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:17.408241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3164a-226f-40f7-bd2a-021a66a09ab2 admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:17.427219 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db25ae-5613-4dcf-8aba-c71f735d4a42 admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:17.432888 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d346-8f0e-426e-96ce-b036a1c1931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:17.433866 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d346-8f0e-426e-96ce-b036a1c1931f admin admin] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:17.434151 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d346-8f0e-426e-96ce-b036a1c1931f admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:17.434498 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d346-8f0e-426e-96ce-b036a1c1931f admin admin] PATH_INFO: `/v3/roles` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:17.435509 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39d346-8f0e-426e-96ce-b036a1c1931f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:17.439399 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39d346-8f0e-426e-96ce-b036a1c1931f admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:17.467968 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 612/1187] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 14:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:33:17.472518 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d346-8f0e-426e-96ce-b036a1c1931f admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:17.486189 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028759e-6f9c-44bc-b9d8-b8c606d2d4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:17.487113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028759e-6f9c-44bc-b9d8-b8c606d2d4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:17.488035 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028759e-6f9c-44bc-b9d8-b8c606d2d4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:17.488396 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028759e-6f9c-44bc-b9d8-b8c606d2d4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:17.489480 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028759e-6f9c-44bc-b9d8-b8c606d2d4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:17.493490 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028759e-6f9c-44bc-b9d8-b8c606d2d4e9 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:17.497474 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d346-8f0e-426e-96ce-b036a1c1931f admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:17.503088 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1d70-9bb1-49b4-93d5-b62875566868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:17.510682 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1d70-9bb1-49b4-93d5-b62875566868 admin admin] REQUEST_METHOD: `PUT` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:17.510682 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1d70-9bb1-49b4-93d5-b62875566868 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:17.510682 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1d70-9bb1-49b4-93d5-b62875566868 admin admin] PATH_INFO: `/v3/projects/3df1812bb69d44b58a96bfcce0157e3f/users/d200ac09ec524dfe8da490bc44b28771/roles/61482861f00e45048fc1d45570c4c99b` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:17.510682 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf1d70-9bb1-49b4-93d5-b62875566868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df1812bb69d44b58a96bfcce0157e3f, user_id=d200ac09ec524dfe8da490bc44b28771, role_id=61482861f00e45048fc1d45570c4c99b)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:17.511072 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf1d70-9bb1-49b4-93d5-b62875566868 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:17.517899 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 576/1188] 10.222.0.59 () {58 vars in 1121 bytes} [Thu Jun 2 14:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:33:17.519411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028759e-6f9c-44bc-b9d8-b8c606d2d4e9 admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:17.532180 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 613/1189] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 14:33:17 2022] PUT /identity/v3/projects/3df1812bb69d44b58a96bfcce0157e3f/users/d200ac09ec524dfe8da490bc44b28771/roles/61482861f00e45048fc1d45570c4c99b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:33:17.532421 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028759e-6f9c-44bc-b9d8-b8c606d2d4e9 admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:17.545213 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:17.608128 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d4aa-b9e6-4406-a6d7-047476417013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:17.610030 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d4aa-b9e6-4406-a6d7-047476417013 admin admin] REQUEST_METHOD: `PUT` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:17.610551 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d4aa-b9e6-4406-a6d7-047476417013 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:17.611208 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d4aa-b9e6-4406-a6d7-047476417013 admin admin] PATH_INFO: `/v3/projects/0738cf235d7947cf81203ad56d183c75/users/a967f6f0bb694ebd92090ced0d67d180/roles/61482861f00e45048fc1d45570c4c99b` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:17.614924 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d4aa-b9e6-4406-a6d7-047476417013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0738cf235d7947cf81203ad56d183c75, user_id=a967f6f0bb694ebd92090ced0d67d180, role_id=61482861f00e45048fc1d45570c4c99b)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:17.618428 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d4aa-b9e6-4406-a6d7-047476417013 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:17.633917 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 577/1190] 10.222.0.59 () {60 vars in 1482 bytes} [Thu Jun 2 14:33:17 2022] PUT /identity/v3/projects/0738cf235d7947cf81203ad56d183c75/users/a967f6f0bb694ebd92090ced0d67d180/roles/61482861f00e45048fc1d45570c4c99b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:33:25.449652 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82f43d-adce-4ad7-9364-569132986b1b None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:25.450228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82f43d-adce-4ad7-9364-569132986b1b None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:25.450228 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82f43d-adce-4ad7-9364-569132986b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:25.482365 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-5a82f43d-adce-4ad7-9364-569132986b1b None None] MFA Rules not processed for user `d200ac09ec524dfe8da490bc44b28771`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:25.483960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-5a82f43d-adce-4ad7-9364-569132986b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:25.545323 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:25.599888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69678cbf-34ea-4f93-a6bd-2938fc464556 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:25.606179 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69678cbf-34ea-4f93-a6bd-2938fc464556 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:25.606179 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69678cbf-34ea-4f93-a6bd-2938fc464556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:25.611760 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 614/1191] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:25 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:25.620164 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82f43d-adce-4ad7-9364-569132986b1b None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:25.621822 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-5a82f43d-adce-4ad7-9364-569132986b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:25.642561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-69678cbf-34ea-4f93-a6bd-2938fc464556 None None] MFA Rules not processed for user `a967f6f0bb694ebd92090ced0d67d180`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:25.644050 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-69678cbf-34ea-4f93-a6bd-2938fc464556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:25.698575 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82f43d-adce-4ad7-9364-569132986b1b None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:25.702674 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf1964-a677-437b-9e4b-48f8b0ecf048 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45eae0d918d5451dab9283e2826ffdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:25.703673 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1964-a677-437b-9e4b-48f8b0ecf048 service glance] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:25.703958 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1964-a677-437b-9e4b-48f8b0ecf048 service glance] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:25.704237 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1964-a677-437b-9e4b-48f8b0ecf048 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:25.726753 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 578/1192] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:25 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:25.740411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69678cbf-34ea-4f93-a6bd-2938fc464556 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:25.742412 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-69678cbf-34ea-4f93-a6bd-2938fc464556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:25.760549 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69678cbf-34ea-4f93-a6bd-2938fc464556 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:25.764416 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f7c76-ca3d-47e0-aecb-23ec778ca8d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45eae0d918d5451dab9283e2826ffdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:25.765375 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f7c76-ca3d-47e0-aecb-23ec778ca8d7 service glance] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:25.765667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f7c76-ca3d-47e0-aecb-23ec778ca8d7 service glance] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:25.766108 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f7c76-ca3d-47e0-aecb-23ec778ca8d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:25.777263 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf1964-a677-437b-9e4b-48f8b0ecf048 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:25.779097 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf1964-a677-437b-9e4b-48f8b0ecf048 service glance] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:25.795880 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 615/1193] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:25 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:33:25.845755 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f7c76-ca3d-47e0-aecb-23ec778ca8d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:25.849217 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f7c76-ca3d-47e0-aecb-23ec778ca8d7 service glance] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:25.860381 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 579/1194] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:25 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:33:35.633914 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b14a5-346f-4c85-962e-28a5aa21e61c None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:35.634481 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b14a5-346f-4c85-962e-28a5aa21e61c None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:35.634481 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b14a5-346f-4c85-962e-28a5aa21e61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:35.654419 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-8f5b14a5-346f-4c85-962e-28a5aa21e61c None None] MFA Rules not processed for user `3a1da526fec84abbabd73c479d366966`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:35.656814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-8f5b14a5-346f-4c85-962e-28a5aa21e61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:35.663017 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 616/1195] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:33:35 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:35.854582 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:35.977576 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381e69f-61c2-4238-ba0d-9b3f4d3fb1e8 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:35.977576 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381e69f-61c2-4238-ba0d-9b3f4d3fb1e8 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:35.977896 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381e69f-61c2-4238-ba0d-9b3f4d3fb1e8 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:35.979249 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 580/1196] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 2 14:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:33:35.985068 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7acf3f-432a-49e1-a24f-142c02e8b49f None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:35.985401 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7acf3f-432a-49e1-a24f-142c02e8b49f None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:35.985744 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7acf3f-432a-49e1-a24f-142c02e8b49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:36.006150 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-3e7acf3f-432a-49e1-a24f-142c02e8b49f None None] MFA Rules not processed for user `d9fa78e7e5be4bdcbd5c79a24895299d`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:36.007542 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-3e7acf3f-432a-49e1-a24f-142c02e8b49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:36.076281 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 617/1197] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 2 14:33:35 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:36.082209 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94138580-c84a-4751-90b4-bab8611e4860 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:36.082614 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94138580-c84a-4751-90b4-bab8611e4860 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:36.083017 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94138580-c84a-4751-90b4-bab8611e4860 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:36.084742 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 581/1198] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 2 14:33:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:33:36.089593 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6709a-1bb9-49e2-9ce0-ecf23c799f84 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:36.089948 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6709a-1bb9-49e2-9ce0-ecf23c799f84 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:36.090237 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6709a-1bb9-49e2-9ce0-ecf23c799f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:36.110530 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-7cb6709a-1bb9-49e2-9ce0-ecf23c799f84 None None] MFA Rules not processed for user `d9fa78e7e5be4bdcbd5c79a24895299d`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:36.111949 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-7cb6709a-1bb9-49e2-9ce0-ecf23c799f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:36.132912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 618/1199] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 14:33:36 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:36.145163 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94138580-c84a-4751-90b4-bab8611e4860 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:36.157100 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94138580-c84a-4751-90b4-bab8611e4860 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:36.163020 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc87607-d93c-44b2-8e2b-d6150a8f13c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45eae0d918d5451dab9283e2826ffdb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:36.163765 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc87607-d93c-44b2-8e2b-d6150a8f13c1 service glance] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:36.164103 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc87607-d93c-44b2-8e2b-d6150a8f13c1 service glance] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:36.164424 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc87607-d93c-44b2-8e2b-d6150a8f13c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:36.177512 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc87607-d93c-44b2-8e2b-d6150a8f13c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:36.179343 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc87607-d93c-44b2-8e2b-d6150a8f13c1 service glance] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:36.189838 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 582/1200] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:36 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:33:36.646655 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fae403-7ab7-43ec-9975-640f20224785 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:36.647570 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fae403-7ab7-43ec-9975-640f20224785 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:36.648029 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fae403-7ab7-43ec-9975-640f20224785 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:36.649429 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 619/1201] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 2 14:33:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:33:36.654831 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe166d3-07b2-4c9b-b931-177021a5d63b None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:36.655348 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe166d3-07b2-4c9b-b931-177021a5d63b None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:36.655629 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe166d3-07b2-4c9b-b931-177021a5d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:36.676823 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-bfe166d3-07b2-4c9b-b931-177021a5d63b None None] MFA Rules not processed for user `85bda15c821448e8b98ae81efb135f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:36.678080 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-bfe166d3-07b2-4c9b-b931-177021a5d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:36.733167 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 583/1202] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 14:33:36 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:36.745090 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fae403-7ab7-43ec-9975-640f20224785 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:36.757663 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fae403-7ab7-43ec-9975-640f20224785 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:36.761393 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e83237-bd52-477e-ac9d-200f03adf1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:36.762038 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e83237-bd52-477e-ac9d-200f03adf1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:36.762322 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e83237-bd52-477e-ac9d-200f03adf1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:36.762606 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e83237-bd52-477e-ac9d-200f03adf1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:36.785521 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e83237-bd52-477e-ac9d-200f03adf1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:36.787149 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e83237-bd52-477e-ac9d-200f03adf1e2 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:36.792458 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=100 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:36.796750 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 620/1203] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:36 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:33:37.293374 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c043e0-38e6-4a40-a6d6-38a131ea7c1b None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:37.293813 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c043e0-38e6-4a40-a6d6-38a131ea7c1b None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:37.293813 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c043e0-38e6-4a40-a6d6-38a131ea7c1b None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:37.295224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 584/1204] 10.222.0.59 () {54 vars in 961 bytes} [Thu Jun 2 14:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:33:37.300944 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb7898-514b-4298-87f5-dac73ee81e72 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:37.301239 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb7898-514b-4298-87f5-dac73ee81e72 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:37.301524 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb7898-514b-4298-87f5-dac73ee81e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:37.312205 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47265bdf-2b6d-4e5e-92e1-1d8c964e7653 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:37.312497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47265bdf-2b6d-4e5e-92e1-1d8c964e7653 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:37.312778 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47265bdf-2b6d-4e5e-92e1-1d8c964e7653 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:37.314141 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 585/1205] 10.222.0.59 () {54 vars in 960 bytes} [Thu Jun 2 14:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:33:37.320824 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab173c3-b495-41f2-bb57-850e00a4d007 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:37.321113 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab173c3-b495-41f2-bb57-850e00a4d007 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:37.321390 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab173c3-b495-41f2-bb57-850e00a4d007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:37.325982 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-67bb7898-514b-4298-87f5-dac73ee81e72 None None] MFA Rules not processed for user `d9fa78e7e5be4bdcbd5c79a24895299d`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:37.327307 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-67bb7898-514b-4298-87f5-dac73ee81e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:37.339525 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 621/1206] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Jun 2 14:33:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:37.342811 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-fab173c3-b495-41f2-bb57-850e00a4d007 None None] MFA Rules not processed for user `f2fb1743d8104deea9914b232c944962`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:37.344255 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5941f0-ef41-47c4-9d8a-883f71ec4508 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:37.344386 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-fab173c3-b495-41f2-bb57-850e00a4d007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:37.344694 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5941f0-ef41-47c4-9d8a-883f71ec4508 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:37.344985 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5941f0-ef41-47c4-9d8a-883f71ec4508 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:37.346377 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 622/1207] 10.222.0.59 () {54 vars in 912 bytes} [Thu Jun 2 14:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 14:33:37.352815 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748754c-a3bc-40df-8d47-295a34f22534 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:37.353113 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748754c-a3bc-40df-8d47-295a34f22534 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:37.353403 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748754c-a3bc-40df-8d47-295a34f22534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:37.374266 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-9748754c-a3bc-40df-8d47-295a34f22534 None None] MFA Rules not processed for user `d9fa78e7e5be4bdcbd5c79a24895299d`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:37.375548 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-9748754c-a3bc-40df-8d47-295a34f22534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:37.385390 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 623/1208] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 14:33:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:33:37.397468 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748754c-a3bc-40df-8d47-295a34f22534 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:37.407587 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748754c-a3bc-40df-8d47-295a34f22534 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:37.411501 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f204fa4-d2cc-4dd8-bc42-8e4397d7f7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:37.412139 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204fa4-d2cc-4dd8-bc42-8e4397d7f7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:37.412453 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204fa4-d2cc-4dd8-bc42-8e4397d7f7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:37.412723 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204fa4-d2cc-4dd8-bc42-8e4397d7f7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:37.422599 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 586/1209] 10.222.0.59 () {58 vars in 1057 bytes} [Thu Jun 2 14:33:37 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:33:37.426198 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f204fa4-d2cc-4dd8-bc42-8e4397d7f7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:37.427823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f204fa4-d2cc-4dd8-bc42-8e4397d7f7b8 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:37.430241 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab173c3-b495-41f2-bb57-850e00a4d007 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:37.439696 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 624/1210] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:33:37.439870 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab173c3-b495-41f2-bb57-850e00a4d007 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:37.446304 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d5594-75f4-45fe-a67f-8d441102c6fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fb1743d8104deea9914b232c944962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:37.447002 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d5594-75f4-45fe-a67f-8d441102c6fb service placement] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:37.447288 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d5594-75f4-45fe-a67f-8d441102c6fb service placement] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:37.447567 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d5594-75f4-45fe-a67f-8d441102c6fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:37.449418 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-7a4d5594-75f4-45fe-a67f-8d441102c6fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:37.462362 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d5594-75f4-45fe-a67f-8d441102c6fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:37.464053 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d5594-75f4-45fe-a67f-8d441102c6fb service placement] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:37.475888 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 587/1211] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:37 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:33:47.435015 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=12 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:47.471238 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=64 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:33:49.162023 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec14286-2ce7-4388-bdd9-ceb1cd046998 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:49.162579 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec14286-2ce7-4388-bdd9-ceb1cd046998 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:49.162579 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec14286-2ce7-4388-bdd9-ceb1cd046998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:49.180418 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-4ec14286-2ce7-4388-bdd9-ceb1cd046998 None None] MFA Rules not processed for user `85bda15c821448e8b98ae81efb135f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:49.181625 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-4ec14286-2ce7-4388-bdd9-ceb1cd046998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:49.188066 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 625/1212] 10.222.0.72 () {58 vars in 1015 bytes} [Thu Jun 2 14:33:49 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:49.200458 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d5594-75f4-45fe-a67f-8d441102c6fb service placement] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:49.210994 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d5594-75f4-45fe-a67f-8d441102c6fb service placement] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:49.214948 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce77ca-4714-4e51-ae98-15deb852b107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:49.215590 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce77ca-4714-4e51-ae98-15deb852b107 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:49.215871 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce77ca-4714-4e51-ae98-15deb852b107 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:49.216142 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce77ca-4714-4e51-ae98-15deb852b107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:49.223581 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce77ca-4714-4e51-ae98-15deb852b107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:49.228690 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce77ca-4714-4e51-ae98-15deb852b107 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:49.232780 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 588/1213] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:49 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:33:50.264327 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617aa16-c467-447d-95fc-754393388ef8 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:50.267527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617aa16-c467-447d-95fc-754393388ef8 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:50.267527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617aa16-c467-447d-95fc-754393388ef8 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:50.267527 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 626/1214] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 14:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:33:50.275422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b783-d2e5-4f9a-8d8b-ca6b0f999e06 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:50.275996 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b783-d2e5-4f9a-8d8b-ca6b0f999e06 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:50.276090 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b783-d2e5-4f9a-8d8b-ca6b0f999e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:50.298095 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-a614b783-d2e5-4f9a-8d8b-ca6b0f999e06 None None] MFA Rules not processed for user `d9fa78e7e5be4bdcbd5c79a24895299d`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:50.300274 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-a614b783-d2e5-4f9a-8d8b-ca6b0f999e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:50.312574 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 589/1215] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 14:33:50 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:50.341486 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617aa16-c467-447d-95fc-754393388ef8 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:50.359301 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617aa16-c467-447d-95fc-754393388ef8 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:50.365338 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf195e29-a28c-4218-aac8-c7da8b9515dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:50.366117 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195e29-a28c-4218-aac8-c7da8b9515dc service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:50.366395 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195e29-a28c-4218-aac8-c7da8b9515dc service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:50.366889 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195e29-a28c-4218-aac8-c7da8b9515dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:50.380799 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf195e29-a28c-4218-aac8-c7da8b9515dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:50.382407 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf195e29-a28c-4218-aac8-c7da8b9515dc service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:50.393025 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 627/1216] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:50 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:33:55.994444 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4afa83-1ef6-4bce-a4a0-7e0218aa52b1 None None] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:55.995202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4afa83-1ef6-4bce-a4a0-7e0218aa52b1 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:55.995202 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4afa83-1ef6-4bce-a4a0-7e0218aa52b1 None None] PATH_INFO: `/` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:55.996788 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 590/1217] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 14:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:33:56.006018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea15223-d338-407e-a95b-9600e6a24a86 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:56.006606 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea15223-d338-407e-a95b-9600e6a24a86 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:56.006606 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea15223-d338-407e-a95b-9600e6a24a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:56.030629 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-9ea15223-d338-407e-a95b-9600e6a24a86 None None] MFA Rules not processed for user `d9fa78e7e5be4bdcbd5c79a24895299d`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:33:56.031912 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-9ea15223-d338-407e-a95b-9600e6a24a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:33:56.041242 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 628/1218] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 14:33:56 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:33:56.054300 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4afa83-1ef6-4bce-a4a0-7e0218aa52b1 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:33:56.070735 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4afa83-1ef6-4bce-a4a0-7e0218aa52b1 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:33:56.077250 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7167c7e-3412-4225-b331-6c1c8bbc9efd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:33:56.078260 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7167c7e-3412-4225-b331-6c1c8bbc9efd service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:33:56.078759 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7167c7e-3412-4225-b331-6c1c8bbc9efd service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:33:56.079222 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7167c7e-3412-4225-b331-6c1c8bbc9efd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:33:56.088710 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7167c7e-3412-4225-b331-6c1c8bbc9efd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:33:56.090509 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7167c7e-3412-4225-b331-6c1c8bbc9efd service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:33:56.101282 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 591/1219] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:33:56 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:34:06.023390 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=12 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:34:06.096973 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=15 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:34:09.643579 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea15223-d338-407e-a95b-9600e6a24a86 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:34:09.653604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea15223-d338-407e-a95b-9600e6a24a86 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:34:09.657262 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cded014-f22e-4f67-bae2-ab0f11f3b51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:34:09.657904 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded014-f22e-4f67-bae2-ab0f11f3b51c service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:34:09.658187 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded014-f22e-4f67-bae2-ab0f11f3b51c service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:34:09.658466 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded014-f22e-4f67-bae2-ab0f11f3b51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:34:09.668096 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cded014-f22e-4f67-bae2-ab0f11f3b51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:34:09.669553 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cded014-f22e-4f67-bae2-ab0f11f3b51c service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:34:09.679295 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 629/1220] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:34:09 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:34:19.675132 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=6 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:35:22.478093 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2e11f-054f-4ab0-9136-e007d3aa2911 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:35:22.484680 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2e11f-054f-4ab0-9136-e007d3aa2911 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:35:22.484680 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2e11f-054f-4ab0-9136-e007d3aa2911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:35:22.510358 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-96a2e11f-054f-4ab0-9136-e007d3aa2911 None None] MFA Rules not processed for user `dd6fd19ff66f47f8b93704a90f19d53b`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:35:22.511561 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-96a2e11f-054f-4ab0-9136-e007d3aa2911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:35:22.540325 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 592/1221] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:35:22 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:35:32.537422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=15 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:35:39.861256 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ab743-d85e-4e77-b21e-cdb29a481953 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:35:39.861817 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ab743-d85e-4e77-b21e-cdb29a481953 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:35:39.861817 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ab743-d85e-4e77-b21e-cdb29a481953 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:35:39.863266 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 630/1222] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 14:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:35:39.873000 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7cfc-ee0b-49b8-a95a-931bb5e1ff66 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:35:39.873454 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7cfc-ee0b-49b8-a95a-931bb5e1ff66 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:35:39.873741 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7cfc-ee0b-49b8-a95a-931bb5e1ff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:35:39.925566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-695e7cfc-ee0b-49b8-a95a-931bb5e1ff66 None None] MFA Rules not processed for user `f2fb1743d8104deea9914b232c944962`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:35:39.925566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-695e7cfc-ee0b-49b8-a95a-931bb5e1ff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:35:39.958031 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 593/1223] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 14:35:39 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:35:39.969154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ab743-d85e-4e77-b21e-cdb29a481953 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:35:40.003220 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ab743-d85e-4e77-b21e-cdb29a481953 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:35:40.016589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be89c08-c070-494d-beaa-5b13813b1d20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fb1743d8104deea9914b232c944962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:35:40.017256 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89c08-c070-494d-beaa-5b13813b1d20 service placement] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:35:40.017545 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89c08-c070-494d-beaa-5b13813b1d20 service placement] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:35:40.017827 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89c08-c070-494d-beaa-5b13813b1d20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:35:40.028445 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be89c08-c070-494d-beaa-5b13813b1d20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:35:40.030247 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be89c08-c070-494d-beaa-5b13813b1d20 service placement] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:35:40.047064 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 631/1224] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:35:39 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:35:43.855551 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7cfc-ee0b-49b8-a95a-931bb5e1ff66 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:35:43.957307 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7cfc-ee0b-49b8-a95a-931bb5e1ff66 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:35:43.965846 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:35:43.966938 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:35:43.967189 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:35:43.967593 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] PATH_INFO: `/v3/users/3a1da526fec84abbabd73c479d366966` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:35:43.969196 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1da526fec84abbabd73c479d366966)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:35:43.970907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:35:44.249224 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1da526fec84abbabd73c479d366966'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:44.262349 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1da526fec84abbabd73c479d366966'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:44.364907 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1da526fec84abbabd73c479d366966'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:44.373416 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1da526fec84abbabd73c479d366966'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:44.374083 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1da526fec84abbabd73c479d366966'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:44.383527 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 594/1225] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 14:35:43 2022] DELETE /identity/v3/users/3a1da526fec84abbabd73c479d366966 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:35:44.640046 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be89c08-c070-494d-beaa-5b13813b1d20 service placement] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:35:44.651553 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be89c08-c070-494d-beaa-5b13813b1d20 service placement] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:35:44.710003 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:35:44.712279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:35:44.712279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:35:44.712279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] PATH_INFO: `/v3/projects/3e2d83635dab4b1cbaf3ecde5626623c` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:35:44.713330 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2d83635dab4b1cbaf3ecde5626623c)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:35:44.715363 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:35:44.868984 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2d83635dab4b1cbaf3ecde5626623c', 'request_id': 'req-cd7001cc-e6d6-4fb5-b600-b194641d619a'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:44.875462 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2d83635dab4b1cbaf3ecde5626623c', 'request_id': 'req-cd7001cc-e6d6-4fb5-b600-b194641d619a'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:44.952960 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2d83635dab4b1cbaf3ecde5626623c', 'request_id': 'req-cd7001cc-e6d6-4fb5-b600-b194641d619a'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:44.976686 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] The token cache is being invalidate because project 3e2d83635dab4b1cbaf3ecde5626623c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:35:44.976974 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:44.978409 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:44.979977 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 632/1226] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 14:35:44 2022] DELETE /identity/v3/projects/3e2d83635dab4b1cbaf3ecde5626623c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:35:44.984040 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:35:44.985839 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:35:44.998931 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f10446-36fb-486e-a6c3-b2e95d902adf admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:35:45.010556 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:35:45.055856 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:35:45.056730 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:35:45.057010 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:35:45.057282 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] PATH_INFO: `/v3/users/a967f6f0bb694ebd92090ced0d67d180` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:35:45.058461 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a967f6f0bb694ebd92090ced0d67d180)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:35:45.060688 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:35:45.240892 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a967f6f0bb694ebd92090ced0d67d180'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:45.252525 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a967f6f0bb694ebd92090ced0d67d180'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:45.318566 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a967f6f0bb694ebd92090ced0d67d180'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:45.326808 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a967f6f0bb694ebd92090ced0d67d180'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:45.327452 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-42c86a61-e534-47c9-b2a2-1f3a428481b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a967f6f0bb694ebd92090ced0d67d180'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:45.333422 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 595/1227] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 14:35:44 2022] DELETE /identity/v3/users/a967f6f0bb694ebd92090ced0d67d180 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:35:45.617166 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:35:45.618667 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:35:45.632818 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7001cc-e6d6-4fb5-b600-b194641d619a admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:35:45.691252 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:35:45.692119 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:35:45.692409 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:35:45.692692 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] PATH_INFO: `/v3/projects/0738cf235d7947cf81203ad56d183c75` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:35:45.693883 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0738cf235d7947cf81203ad56d183c75)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:35:45.695877 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:35:45.704945 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:35:45.799154 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0738cf235d7947cf81203ad56d183c75', 'request_id': 'req-4b95cc9e-1fdf-4351-a875-60f91fb463c3'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:45.805156 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0738cf235d7947cf81203ad56d183c75', 'request_id': 'req-4b95cc9e-1fdf-4351-a875-60f91fb463c3'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:45.884166 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0738cf235d7947cf81203ad56d183c75', 'request_id': 'req-4b95cc9e-1fdf-4351-a875-60f91fb463c3'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:45.895278 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] The token cache is being invalidate because project 0738cf235d7947cf81203ad56d183c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:35:45.899511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:45.899511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-4b95cc9e-1fdf-4351-a875-60f91fb463c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:35:45.899511 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 633/1228] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 14:35:45 2022] DELETE /identity/v3/projects/0738cf235d7947cf81203ad56d183c75 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:35:55.329954 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:35:55.892034 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:36:02.053178 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fd47-8ed4-487e-9429-f8c7e63805c0 None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:36:02.053656 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fd47-8ed4-487e-9429-f8c7e63805c0 None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:36:02.053766 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fd47-8ed4-487e-9429-f8c7e63805c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:36:02.071211 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-3746fd47-8ed4-487e-9429-f8c7e63805c0 None None] MFA Rules not processed for user `dd6fd19ff66f47f8b93704a90f19d53b`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:36:02.072409 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-3746fd47-8ed4-487e-9429-f8c7e63805c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:36:02.128834 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 596/1229] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:36:02 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:36:02.393994 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5027740-f6fd-4417-b520-d26451f65eba None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:36:02.394440 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5027740-f6fd-4417-b520-d26451f65eba None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:36:02.394520 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5027740-f6fd-4417-b520-d26451f65eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:36:02.430649 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-b5027740-f6fd-4417-b520-d26451f65eba None None] MFA Rules not processed for user `85bda15c821448e8b98ae81efb135f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:36:02.432490 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-b5027740-f6fd-4417-b520-d26451f65eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:36:02.490569 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 634/1230] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Jun 2 14:36:02 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:36:02.502274 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746fd47-8ed4-487e-9429-f8c7e63805c0 None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:36:02.503728 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-3746fd47-8ed4-487e-9429-f8c7e63805c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:36:02.516262 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746fd47-8ed4-487e-9429-f8c7e63805c0 None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:36:02.519767 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d8f9-b533-463a-9804-28ea1defca9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:36:02.520389 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d8f9-b533-463a-9804-28ea1defca9d service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:36:02.520670 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d8f9-b533-463a-9804-28ea1defca9d service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:36:02.520945 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d8f9-b533-463a-9804-28ea1defca9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:36:02.528543 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8d8f9-b533-463a-9804-28ea1defca9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:36:02.529957 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8d8f9-b533-463a-9804-28ea1defca9d service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:36:02.537583 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 597/1231] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:36:02 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:36:12.487789 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=33 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:36:12.534297 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=31 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:36:18.519279 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd035fb-376d-4151-8104-4dfccb74167d None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:36:18.519799 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd035fb-376d-4151-8104-4dfccb74167d None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:36:18.519894 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd035fb-376d-4151-8104-4dfccb74167d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:36:18.538560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-5dd035fb-376d-4151-8104-4dfccb74167d None None] MFA Rules not processed for user `dd6fd19ff66f47f8b93704a90f19d53b`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:36:18.539808 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-5dd035fb-376d-4151-8104-4dfccb74167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:36:18.548028 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 635/1232] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:36:18 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:36:28.533356 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:36:32.905994 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d8f9-b533-463a-9804-28ea1defca9d service neutron] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:36:32.912814 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-32f8d8f9-b533-463a-9804-28ea1defca9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:36:32.986039 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d8f9-b533-463a-9804-28ea1defca9d service neutron] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:36:32.991238 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069fde4-fc5d-4afb-ad55-9f3d67d557ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fb1743d8104deea9914b232c944962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:36:32.991897 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069fde4-fc5d-4afb-ad55-9f3d67d557ef service placement] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:36:32.992184 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069fde4-fc5d-4afb-ad55-9f3d67d557ef service placement] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:36:32.992463 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069fde4-fc5d-4afb-ad55-9f3d67d557ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:36:32.994281 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-3069fde4-fc5d-4afb-ad55-9f3d67d557ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:36:33.006580 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069fde4-fc5d-4afb-ad55-9f3d67d557ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:36:33.008251 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069fde4-fc5d-4afb-ad55-9f3d67d557ef service placement] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:36:33.018758 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 598/1233] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:36:32 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:36:43.015067 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=36 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:37:37.398015 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de99b07-fa8a-4992-8ebc-83fc59e21c70 None None] REQUEST_METHOD: `POST` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:37:37.398542 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de99b07-fa8a-4992-8ebc-83fc59e21c70 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:37:37.398542 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de99b07-fa8a-4992-8ebc-83fc59e21c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:37:37.417332 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.auth.core [None req-7de99b07-fa8a-4992-8ebc-83fc59e21c70 None None] MFA Rules not processed for user `dd6fd19ff66f47f8b93704a90f19d53b`. Rule list: `[]` (Enabled: `True`). {{(pid=87231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:37:37.418584 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-7de99b07-fa8a-4992-8ebc-83fc59e21c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:37:37.425436 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 636/1234] 10.222.0.59 () {58 vars in 957 bytes} [Thu Jun 2 14:37:37 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:37:47.411620 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=3 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:37:51.444269 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069fde4-fc5d-4afb-ad55-9f3d67d557ef service placement] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:37:51.454071 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069fde4-fc5d-4afb-ad55-9f3d67d557ef service placement] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:37:51.457676 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a789ce1-0204-40f5-8321-ee2b7ee68d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:37:51.458340 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a789ce1-0204-40f5-8321-ee2b7ee68d8a service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:37:51.458623 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a789ce1-0204-40f5-8321-ee2b7ee68d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:37:51.459086 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a789ce1-0204-40f5-8321-ee2b7ee68d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:37:51.460858 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-0a789ce1-0204-40f5-8321-ee2b7ee68d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:37:51.524776 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a789ce1-0204-40f5-8321-ee2b7ee68d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:37:51.526255 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a789ce1-0204-40f5-8321-ee2b7ee68d8a service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:37:51.536195 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 599/1235] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:37:51 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:38:01.532124 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=30 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:39:33.553827 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de99b07-fa8a-4992-8ebc-83fc59e21c70 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:39:33.563277 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de99b07-fa8a-4992-8ebc-83fc59e21c70 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:39:33.566899 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e7f4-0a17-4b93-8f70-533698ec6029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:39:33.567541 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e7f4-0a17-4b93-8f70-533698ec6029 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:39:33.567823 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e7f4-0a17-4b93-8f70-533698ec6029 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:39:33.568098 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e7f4-0a17-4b93-8f70-533698ec6029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:39:33.570560 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-dd98e7f4-0a17-4b93-8f70-533698ec6029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:39:33.580035 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e7f4-0a17-4b93-8f70-533698ec6029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:39:33.581472 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e7f4-0a17-4b93-8f70-533698ec6029 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:39:33.590055 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 637/1236] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:39:33 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:39:43.586700 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=6 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:41:11.428412 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a789ce1-0204-40f5-8321-ee2b7ee68d8a service neutron] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:11.431370 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-0a789ce1-0204-40f5-8321-ee2b7ee68d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:11.518372 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a789ce1-0204-40f5-8321-ee2b7ee68d8a service neutron] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:11.523602 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b36f1-1859-4cef-9485-e3780a9ae634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:11.524247 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b36f1-1859-4cef-9485-e3780a9ae634 service nova] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:11.524541 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b36f1-1859-4cef-9485-e3780a9ae634 service nova] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:11.524821 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b36f1-1859-4cef-9485-e3780a9ae634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:11.526600 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-2e7b36f1-1859-4cef-9485-e3780a9ae634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:11.537712 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b36f1-1859-4cef-9485-e3780a9ae634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:11.539355 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b36f1-1859-4cef-9485-e3780a9ae634 service nova] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:11.548235 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 600/1237] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:41:11 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:41:13.289490 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e7f4-0a17-4b93-8f70-533698ec6029 service neutron] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:13.302928 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e7f4-0a17-4b93-8f70-533698ec6029 service neutron] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:13.308196 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a20fe-2bac-443b-b394-16c07e8f8a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9fa78e7e5be4bdcbd5c79a24895299d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:13.309018 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a20fe-2bac-443b-b394-16c07e8f8a4a service nova] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:13.309300 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a20fe-2bac-443b-b394-16c07e8f8a4a service nova] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:13.309656 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a20fe-2bac-443b-b394-16c07e8f8a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:13.311761 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-350a20fe-2bac-443b-b394-16c07e8f8a4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:13.326760 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a20fe-2bac-443b-b394-16c07e8f8a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:13.326760 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a20fe-2bac-443b-b394-16c07e8f8a4a service nova] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:13.338255 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 638/1238] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:41:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:41:13.847393 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b36f1-1859-4cef-9485-e3780a9ae634 service nova] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:13.857598 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b36f1-1859-4cef-9485-e3780a9ae634 service nova] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:13.861358 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8d105-3ca4-4779-b7a9-a21a2813ae20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:13.862004 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8d105-3ca4-4779-b7a9-a21a2813ae20 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:13.862289 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8d105-3ca4-4779-b7a9-a21a2813ae20 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:13.862567 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8d105-3ca4-4779-b7a9-a21a2813ae20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:13.864411 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-bcd8d105-3ca4-4779-b7a9-a21a2813ae20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:13.877497 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8d105-3ca4-4779-b7a9-a21a2813ae20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:13.878978 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8d105-3ca4-4779-b7a9-a21a2813ae20 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:13.891155 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 601/1239] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:41:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:41:15.085952 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a20fe-2bac-443b-b394-16c07e8f8a4a service nova] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:15.095046 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a20fe-2bac-443b-b394-16c07e8f8a4a service nova] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:15.098532 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ecd08-2687-41c4-94c8-be99b055fc77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:15.100020 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ecd08-2687-41c4-94c8-be99b055fc77 service neutron] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:15.100303 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ecd08-2687-41c4-94c8-be99b055fc77 service neutron] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:15.100576 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ecd08-2687-41c4-94c8-be99b055fc77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:15.102348 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-826ecd08-2687-41c4-94c8-be99b055fc77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:15.115917 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ecd08-2687-41c4-94c8-be99b055fc77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:15.117344 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ecd08-2687-41c4-94c8-be99b055fc77 service neutron] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:15.127333 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 639/1240] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:41:15 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:41:23.886610 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=47 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:41:25.122898 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=12 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:41:25.379621 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8d105-3ca4-4779-b7a9-a21a2813ae20 service neutron] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:25.388648 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8d105-3ca4-4779-b7a9-a21a2813ae20 service neutron] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:25.392386 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac11b46-a8c1-43ba-b985-caa142274e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bda15c821448e8b98ae81efb135f3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:25.393056 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac11b46-a8c1-43ba-b985-caa142274e91 service neutron] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:25.393341 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac11b46-a8c1-43ba-b985-caa142274e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:25.393616 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac11b46-a8c1-43ba-b985-caa142274e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:25.395412 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-8ac11b46-a8c1-43ba-b985-caa142274e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:25.457727 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac11b46-a8c1-43ba-b985-caa142274e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:25.459934 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac11b46-a8c1-43ba-b985-caa142274e91 service neutron] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:25.468934 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 602/1241] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:41:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:41:28.728832 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec9444-cfa9-4c33-8c98-adcabf146e42 None None] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:28.729450 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec9444-cfa9-4c33-8c98-adcabf146e42 None None] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:28.729744 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec9444-cfa9-4c33-8c98-adcabf146e42 None None] PATH_INFO: `/` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:28.731157 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 640/1242] 10.222.0.59 () {54 vars in 921 bytes} [Thu Jun 2 14:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 14:41:28.742145 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90de5-c7bc-4415-8f84-0acb45af157c None None] REQUEST_METHOD: `POST` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:28.742621 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90de5-c7bc-4415-8f84-0acb45af157c None None] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:28.742743 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90de5-c7bc-4415-8f84-0acb45af157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:28.792230 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.auth.core [None req-dfe90de5-c7bc-4415-8f84-0acb45af157c None None] MFA Rules not processed for user `f2fb1743d8104deea9914b232c944962`. Rule list: `[]` (Enabled: `True`). {{(pid=87232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:41:28.793365 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-dfe90de5-c7bc-4415-8f84-0acb45af157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:28.801899 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 603/1243] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Jun 2 14:41:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:41:28.812604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec9444-cfa9-4c33-8c98-adcabf146e42 None None] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:28.825893 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec9444-cfa9-4c33-8c98-adcabf146e42 None None] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:28.830861 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f428b-b5c7-4d14-bb24-1ebc88f3745d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fb1743d8104deea9914b232c944962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:28.831493 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f428b-b5c7-4d14-bb24-1ebc88f3745d service placement] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:28.834491 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f428b-b5c7-4d14-bb24-1ebc88f3745d service placement] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:28.834491 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f428b-b5c7-4d14-bb24-1ebc88f3745d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:28.840814 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f428b-b5c7-4d14-bb24-1ebc88f3745d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:28.842383 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f428b-b5c7-4d14-bb24-1ebc88f3745d service placement] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:28.852618 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 641/1244] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:41:28 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:41:32.461961 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90de5-c7bc-4415-8f84-0acb45af157c None None] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:32.469264 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90de5-c7bc-4415-8f84-0acb45af157c None None] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:32.474220 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebb545-f9e7-4d42-897d-1e831eb75523 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fb1743d8104deea9914b232c944962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:32.474895 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebb545-f9e7-4d42-897d-1e831eb75523 service placement] REQUEST_METHOD: `GET` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:32.475744 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebb545-f9e7-4d42-897d-1e831eb75523 service placement] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:32.476019 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebb545-f9e7-4d42-897d-1e831eb75523 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:32.477803 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-e3ebb545-f9e7-4d42-897d-1e831eb75523 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:32.489654 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebb545-f9e7-4d42-897d-1e831eb75523 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:32.491876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebb545-f9e7-4d42-897d-1e831eb75523 service placement] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:32.501783 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 604/1245] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:41:32 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:41:32.592092 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f428b-b5c7-4d14-bb24-1ebc88f3745d service placement] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:32.593655 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-bb2f428b-b5c7-4d14-bb24-1ebc88f3745d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:32.609794 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f428b-b5c7-4d14-bb24-1ebc88f3745d service placement] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:32.614292 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:32.615182 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:32.615566 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:32.616473 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] PATH_INFO: `/v3/users/dd6fd19ff66f47f8b93704a90f19d53b` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:32.617652 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6fd19ff66f47f8b93704a90f19d53b)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:32.618675 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: WARNING py.warnings [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:41:32.618675 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: warnings.warn(msg) Jun 02 14:41:32.618675 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: Jun 02 14:41:32.619880 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:32.805692 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6fd19ff66f47f8b93704a90f19d53b'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:32.806300 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6fd19ff66f47f8b93704a90f19d53b'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:32.873295 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6fd19ff66f47f8b93704a90f19d53b'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:32.894489 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6fd19ff66f47f8b93704a90f19d53b'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:32.909640 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6fd19ff66f47f8b93704a90f19d53b'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:32.916462 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 642/1246] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 14:41:32 2022] DELETE /identity/v3/users/dd6fd19ff66f47f8b93704a90f19d53b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:41:33.160591 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebb545-f9e7-4d42-897d-1e831eb75523 service placement] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:33.171718 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebb545-f9e7-4d42-897d-1e831eb75523 service placement] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:33.230762 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:33.231659 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:33.231939 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:33.232217 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] PATH_INFO: `/v3/projects/6ba0f2723d364f169cc68eabac2b0427` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:33.233401 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba0f2723d364f169cc68eabac2b0427)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:33.234420 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: WARNING py.warnings [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 14:41:33.234420 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: warnings.warn(msg) Jun 02 14:41:33.234420 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: Jun 02 14:41:33.235667 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:33.384702 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba0f2723d364f169cc68eabac2b0427', 'request_id': 'req-6109e0cd-f1c2-443a-8550-e322d2beaa2d'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:33.387307 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:41:33.467657 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba0f2723d364f169cc68eabac2b0427', 'request_id': 'req-6109e0cd-f1c2-443a-8550-e322d2beaa2d'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:33.474020 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba0f2723d364f169cc68eabac2b0427', 'request_id': 'req-6109e0cd-f1c2-443a-8550-e322d2beaa2d'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:33.491948 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] The token cache is being invalidate because project 6ba0f2723d364f169cc68eabac2b0427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:41:33.492234 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:33.492892 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:33.494492 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 605/1247] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 14:41:33 2022] DELETE /identity/v3/projects/6ba0f2723d364f169cc68eabac2b0427 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:41:33.498804 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:33.500237 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:33.513825 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ded4a5-8cf7-4d99-92d2-960920980f37 admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:33.568604 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:33.570211 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:33.570493 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:33.570798 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] PATH_INFO: `/v3/users/d200ac09ec524dfe8da490bc44b28771` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:33.571999 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d200ac09ec524dfe8da490bc44b28771)` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:33.573913 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:33.747581 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd200ac09ec524dfe8da490bc44b28771'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:33.748589 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd200ac09ec524dfe8da490bc44b28771'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:33.821572 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd200ac09ec524dfe8da490bc44b28771'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:33.827093 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:41:33.834275 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd200ac09ec524dfe8da490bc44b28771'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:33.840963 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.notifications [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd200ac09ec524dfe8da490bc44b28771'} {{(pid=87231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:33.846782 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 643/1248] 10.222.0.59 () {58 vars in 1223 bytes} [Thu Jun 2 14:41:33 2022] DELETE /identity/v3/users/d200ac09ec524dfe8da490bc44b28771 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:41:34.104211 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] Authenticating user token {{(pid=87232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:34.105717 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.fernet_utils [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:34.121523 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e0cd-f1c2-443a-8550-e322d2beaa2d admin admin] Validating token access rules against request {{(pid=87232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:34.181022 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '178ae9fcbcd542059cfd780cab7fed93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47e2c6597d274fcc88b12f356f1b2eb0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:34.181893 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:34.182306 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] SCRIPT_NAME: `/identity` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:34.182588 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] PATH_INFO: `/v3/projects/3df1812bb69d44b58a96bfcce0157e3f` {{(pid=87232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:34.183836 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df1812bb69d44b58a96bfcce0157e3f)` {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:34.185764 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] RBAC: Authorization granted {{(pid=87232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:34.322876 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df1812bb69d44b58a96bfcce0157e3f', 'request_id': 'req-0dfd7418-fef0-4266-9147-26620d648701'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:34.387677 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df1812bb69d44b58a96bfcce0157e3f', 'request_id': 'req-0dfd7418-fef0-4266-9147-26620d648701'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:34.393749 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df1812bb69d44b58a96bfcce0157e3f', 'request_id': 'req-0dfd7418-fef0-4266-9147-26620d648701'} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:34.405607 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] The token cache is being invalidate because project 3df1812bb69d44b58a96bfcce0157e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:41:34.405897 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:34.406524 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG keystone.notifications [None req-0dfd7418-fef0-4266-9147-26620d648701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:41:34.408106 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: [pid: 87232|app: 0|req: 606/1249] 10.222.0.59 () {58 vars in 1232 bytes} [Thu Jun 2 14:41:34 2022] DELETE /identity/v3/projects/3df1812bb69d44b58a96bfcce0157e3f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:41:35.878077 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] Authenticating user token {{(pid=87231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:41:35.879521 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:35.951432 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f4780-15e1-4f34-83b6-ad51a2ede35e admin admin] Validating token access rules against request {{(pid=87231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:41:36.011551 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a9f0-a737-4885-a721-659cc76e7bc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fb1743d8104deea9914b232c944962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5992534cc13499cb1ae95958d96ca9c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:41:36.012206 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a9f0-a737-4885-a721-659cc76e7bc6 service placement] REQUEST_METHOD: `GET` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:41:36.012492 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a9f0-a737-4885-a721-659cc76e7bc6 service placement] SCRIPT_NAME: `/identity` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:41:36.012770 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a9f0-a737-4885-a721-659cc76e7bc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:41:36.014548 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.fernet_utils [None req-5612a9f0-a737-4885-a721-659cc76e7bc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:41:36.027106 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612a9f0-a737-4885-a721-659cc76e7bc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:41:36.028717 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612a9f0-a737-4885-a721-659cc76e7bc6 service placement] RBAC: Authorization granted {{(pid=87231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:41:36.039802 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: [pid: 87231|app: 0|req: 644/1250] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Jun 2 14:41:35 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:41:44.402407 dv-osbrick-830800-17-ceph devstack@keystone.service[87232]: DEBUG dbcounter [-] [87232] Writing DB stats keystone:DELETE=10,keystone:SELECT=57,keystone:INSERT=1 {{(pid=87232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:41:46.035111 dv-osbrick-830800-17-ceph devstack@keystone.service[87231]: DEBUG dbcounter [-] [87231] Writing DB stats keystone:SELECT=67,keystone:DELETE=1 {{(pid=87231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}